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Executive Summary 


The use of accommodations in instruction and assessments continues to be of great importance for 
students with disabilities. This importance is reflected in an emphasis on research to investigate the 
effects of accommodations. Key issues under investigation include how accommodations affect test 
scores, how educators and students perceive accommodations, and how accommodations are selected 
and implemented. 


The purpose of this report is to provide an update on the state of the research on testing accommoda- 
tions as well as to identify promising future areas of research. Previous reports by the National Center 
on Educational Outcomes (NCEO) have covered research published since 1999. We summarize the 
research to review current research trends and enhance understanding of the implications of accom- 
modations use in the development of future policy directions, implementation of current and new 
accommodations, and valid and reliable interpretations when accommodations are used in testing 
situations. For 2011 and 2012, 49 published research studies on the topic of testing accommodations 
were found. Among the main points of the 2011-12 research are: 


Purpose: The majority of the research included in this review sought to report on perceptions 
and preferences about accommodations use. The second most common purpose for research 
was to evaluate the comparability of test scores when assessments were administered with 
and without accommodations. The majority of studies addressed multiple purposes. 


Research design: About 65% of the studies reported primary data collection on the part of 
the researchers, rather than drawing on existing archival data sets. Over two-fifths of the 
studies involved quasi-experimental designs. Researchers also drew on survey techniques 
and carried out literature reviews and a meta-analysis. 


Types of assessments, content areas: A wide variety of instrument types were used in 
these studies. Descriptive surveys and tests were the most common data collection methods 
used in the studies reviewed, as developed by the researchers for the purpose of the study. A 
large number of the studies involved academic content items drawn from specified sources 
outside of the researchers’ work. Other studies used state criterion-referenced test data, 
norm-referenced measures, or multiple types of data in various combinations. Mathematics 
and reading were the most common content areas included in the 2011-2012 research. Other 
content areas were science and writing. Approximately one-third of all studies addressed 
more than one content area in the assessments used. 


Participants: Participants were most frequently students, spanning a range of grade levels 
from K-12 to postsecondary students, although several studies included educators as par- 
ticipants. Studies varied in the number of participants; some studies included fewer than 20 
participants, whereas other studies involved hundreds of thousands of participants. 


Disability categories: Learning disabilities were the most common disabilities 
exhibited by participants in the research, accounting for over one-third of the stud- 
ies. Visual impairments, emotional behavioral disabilities, and speech/language 
impairments were the next most commonly studied. Low-incidence disabilities were 
included in about one-quarter of the studies. 


Accommodations: Presentation accommodations were the most frequently studied 
category, with oral delivery (read-aloud) accommodations being the most studied 
within this category (and across categories). Other commonly studied accommoda- 
tions included computer administration, calculator, and extended time. There were a 
small number, about one-tenth of the studies, which analyzed relatively uncommon 
or unique accommodations from among various categories. 


Findings: Empirical studies investigating performance effects of the extended-time 
accommodation showed a positive impact on assessment scores for students with 
disabilities. The oral delivery accommodations (read aloud by a human reader, 
pre-recorded audio, and text to speech) supported some improvement in scores for 
students with disabilities; however, the performance effects of oral delivery accom- 
modations were mostly conditioned on student characteristics or testing conditions 
for students with disabilities. The findings on calculators showed more positive, 
although nuanced, support for students with disabilities’ performance. Computer 
administration did not demonstrate score improvements. Among studies of percep- 
tions of various accommodations, students mostly described positive experiences 
about using accommodations. Educator perceptions were mostly positive about 
accommodations use; in general, educators were familiar with and knowledgeable 
about accommodations. Accommodations provided during reading and science as- 
sessments did not alter their academic constructs being tested; for science and math 
there were inconsistent findings across validity studies as to whether the accommo- 
dations studied altered the constructs. 


Limitations: The studies identified several results-related limitations that affected 
the accuracy and consistency of the data (e.g., some item sets were not connected to 
state standards). Methodological issues such as when accommodations use patterns 
in extant data sets were not partitioned by specific accommodation, aggregated (vs. 
individually administered) accommodations, and non-random sampling of partici- 
pants were also mentioned as limitations. 


Directions for future research: A number of promising suggestions were noted, 
particularly concerning deepening the meaning of empirical studies by adding qualita- 
tive data sources (methodology); improving the interface between accommodations 


and naturalistic testing conditions (test/test context); and expanding the sample size, age, 
and grade level, and improving the representativeness of samples (sample characteristics). 
In many cases, researchers also found that the results of their studies generated other sug- 
gestions for further investigation. 


The studies in 2011-2012 demonstrated several similarities when viewing them in comparison with 
previous research, especially in relation to the 2009-2010 studies examined in our previous accom- 
modations research review. Continuing trends showed more empirical research on accommodations 
effects at the postsecondary level, and increased accommodations perceptions research that involved 
educators. Researchers continued to build evidence about oral delivery, computer administration, 
calculators, and extended time, yet they also examined unique or unusual accommodations, including 
some high-tech accommodations. Accommodations for mathematics and reading testing continued 
to receive attention. Research designs with multiple purposes persisted. Still, there were several dif- 
ferences, or shifts, as well between research conducted in 2009-2010 and 2011-2012. Science assess- 
ment accommodations research decreased. Inquiry about construct validity became more complex, 
permitting the identification of factors that might influence the interface of accommodations with 
assessments of specific academic subjects. 
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Overview 


All students, including students with disabilities, are required by the Individuals with Disabilities 
Education Act (IDEA) of 2004 and Title I of the 2001 reauthorization of the Elementary and 
Secondary Education Act (ESEA) to participate in assessments used for accountability. Some 
students need accommodations to meaningfully access assessments. States and assessment con- 
sortia look to accommodations research when making policy decisions about accommodations. 


To synthesize accommodations research efforts completed across the years, the National Cen- 
ter on Educational Outcomes (NCEO) has published a series of reports on accommodations 
research. The time periods included 1999-2001 (Thompson, Blount, & Thurlow, 2002), 2002- 
2004 (Johnstone, Altman, Thurlow, & Thompson, 2006), 2005-2006 (Zenisky & Sireci, 2007), 
2007-2008 (Cormier, Altman, Shyyan, & Thurlow, 2010), and 2009-2010 (Rogers, Christian, 
& Thurlow, 2012). This report covers the time period 2011-2012. 


The purpose of this report is to present a synthesis of the research on test accommodations 
published in 2011 and 2012. The literature described here encompasses empirical studies of 
score comparability and validity studies as well as investigations into accommodations use, 
implementation practices, and perceptions of their effectiveness. As a whole, the current re- 
search body offers a broad view and a deep examination of issues pertaining to assessment 
accommodations. Reporting the findings of current research studies was a primary goal of this 
analysis; a secondary goal was to identify areas requiring continued investigation in the future. 


Review Process 


Similar to the process used in past accommodations research syntheses (Cormier et al., 2010; 
Johnstone et al., 2006; Rogers et al., 2012; Thompson et al., 2002; Zenisky & Sireci, 2007), 
a number of sources were accessed to complete the review of the accommodations research 
published in 2011 and 2012. Specifically, five research databases were consulted: Educational 
Resources Information Center (ERIC), PsycINFO, Academic Search Premier, Digital Disserta- 
tions, and Educational Abstracts. To help confirm the thoroughness of our searches, we used the 
Web search engine Google Scholar to search for additional research. In addition, a hand-search 
of 47 journals was completed, in efforts to ensure that no qualifying study was missed. A list of 
hand-searched journals is available on the National Center on Educational Outcomes website 
(www.nceo.info/OnlinePubs/AccommBibliography/AccomStudMethods.htm). 


Online archives of several organizations were also searched for relevant publications. These 
organizations included Behavioral Research and Teaching (BRT) at the University of Oregon 
(http://brt.uoregon.edu), the College Board Research Library (http://research.collegeboard.org), 
the National Center for Research on Evaluation, Standards, and Student Testing (CRESST; 
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http://www.cse.ucla.edu), and the Wisconsin Center for Educational Research (WCER;; http:// 
testacc.wceruw.org/). 


The initial search was completed in December, 2012. A second search was completed in April, 
2013, and a third search in June, 2013, to ensure that all articles published in 2011 and 2012 
were found and included in this review. Within each of these research databases and publications 
archives, we used a sequence of search terms. Terms searched for this review were: 


¢ standardized (also large-scale, state, standards-based) test (also testing) changes 

e standardized (also large-scale, state, standards-based) test (also testing) modification(s) 
e standardized (also large-scale, state, standards-based) test (also testing) 

* accommodation(s) 

e test changes 

¢ test modifications 


¢ test accommodations 


Many of these search terms were used as delimiters when searches yielded large pools of docu- 
ments found to be irrelevant to the searches. 


The research documents from these searches were then considered for inclusion in this review 
with respect to several criteria. First, the decision was made to focus only on research published 
or defended (in doctoral dissertations) in 2011 and 2012. Second, the scope of the research was 
limited to investigations of accommodations for regular assessment; hence, articles specific 
to alternate assessments, accommodations for instruction or learning, and universal design in 
general were not part of this review. Third, research involving English language learners (ELLs) 
was included only if the target population was ELLs with disabilities. Fourth, presentations from 
professional conferences were not searched or included in this review, based on the researchers’ 
criteria to include only research that would be accessible to readers and that had gone through 
the level of peer review typically required for publication in professional journals or through a 
doctoral committee review. (This criterion was implemented for the first time during the 2007- 
2008 review.) Finally, to be included in the online bibliography and summarized in this report, 
studies needed to involve (a) experimental manipulation of an accommodation, (b) investigation 
of the comparability of test scores across accommodated and non-accommodated conditions, 
or (c) examination of survey results about students’ or teachers’ knowledge or perceptions of 
accommodations. 


To reflect the wide range of accommodations research that was conducted in 2011 and 2012, 
the studies are summarized and compared in the following ways: (a) purposes of research; 
(b) research type and data collection source; (c) assessment or data collection focus; (d) charac- 
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teristics of the independent and dependent variables under study; (e) comparability of findings 
between studies in similar domains; and (f) limitations and directions of future research. The 
information provided in each of these categories should provide insight into the current state of 
accommodations research in education and highlight trends in current accommodations research. 


Results 


The results of our analyses of the 49 studies published from January 2011 through December 
2012 are presented in substantive detail. We identify the studies’ publication types, as well as 
the range of research purposes. We specify the types of research approaches and the primary 
and secondary sources of data collection. We also describe the data collection methods and 
instruments. We report the academic content areas covered in the research. We depict research 
participants in terms of their being students, educators, and parents, their ages or grade levels, 
the participant sample sizes and disability status, and their disability categories. We report the 
types of accommodations studied. We also explicate the research findings in terms of the impact 
of accommodations as well as perceptions about accommodations, incidence of accommoda- 
tions use, and implementation. Additional sections offer perspectives on accommodations in 
postsecondary education, the effects of accommodations on construct validity, and the associa- 
tion of accommodations to academic discipline. Finally, limitations and future research direc- 
tions in the assembled body of research literature are presented as reported by the researchers. 
Accommodations research takes a variety of approaches. It ranges from a large-scale approach 
that might examine aggregated accommodations data to an approach that involves testing an 
individual accommodation for a specific disability category. This range of approaches is reflected 
in research questions that focus on areas such as: the use or implementation of accommodations; 
the perception of accommodations by educational professionals, students, and parents; and the 
effects of accommodations on test scores. 


Publication Type 
The results of the review process showed a total of 49 studies were published from January 2011 
through December 2012. As shown in Figure 1, of these 49 studies, 39 were journal articles, 7 


were dissertations, and 3 were published professional reports released by research organizations 
(e.g., CRESST, Behavior Research and Training). 
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Figure 1. Percentage of Accommodations Studies by Publication Type 


Reports 
3 
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7 
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Journal articles 


80% 


The total number of studies published on accommodations in 2011-2012 (n=49) increased only 
slightly since the previous report examining accommodations research published in 2009-2010 
(n=48). There was an increase in the number of journal articles (n=36 in 2009-2010; n=39 in 
2011-2012), and a slight decrease in the number of dissertations published on accommodations 
(n=10 in 2009-2010; n=7 in 2011-2012). The report on accommodations research in 2009- 
2010 included 36 articles from 24 journals; the 39 articles described in the current report were 
found in 23 journals. In 2011-2012 there was a mean of 1.7 articles per journal that included 
any papers about accommodations, as compared to 2009-2010 when there was a mean of 1.5 
articles per journal. 


Purposes of the Research 


A number of purposes were identified in the accommodations research published in 2011 and 
2012. Table 1 provides a view of the predominant focus of each of these 49 studies. Ten studies 
listed single purposes (see Appendix A). The majority of studies sought to accomplish multiple 
purposes. In those cases, we identified the “primary purpose” according to the title of the work 
or the first-mentioned purpose in the text of the work. 
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Table 1. Primary Purpose of Reviewed Research 


Number of Studies 


Compare scores 
only students with disabilities (9 studies) 
only students without disabilities (0 studies) 


both students with and without disabilities (11 studies) 
Study/compare perceptions and preferences about use 
Report on implementation practices and accommodations use 


20 


[Comparetestitems ——SSCSC~C“‘“‘“*‘“rCSC“‘(CCSC“N’SCN™#*#* 
[Discwssissues SS SSCSC“~*‘“*S~*sSC“‘CSCCNCNC#” 
[Eval teststuctre—=SC~“‘“*S*‘“‘“‘SCS*S*sdSSCSC“‘“‘COWNC#‘“‘ 
fowl SCSC—SSSSSSSCCS CS 


The most common primary purpose for research published during 2011-2012 was to report on 
the effect of accommodations on test scores (41%) by comparing scores of students who received 
accommodations to those who did not (see Table A-1 in Appendix A). The next most common 
primary purposes were studying perceptions of the accommodations and preferences between 
or among a small number of accommodations of a certain type, reporting on implementation 
practices and accommodations use, and comparing test items. The third most frequent purpose, 
comparing test items, refers to whether item difficulty or other item-specific content validity 
issues changed when test format changed. Examples of these types of format changes included: 
from print-based to electronic (e.g., Alt & Moreno, 2012; Taherbhai, Seo, & Bowman, 2012), 
or from print to audio presentation (e.g., Shelton, 2012). 


The results presented in Table 1 include some literature reviews. We identified the primary 
purpose of summarizing research in studies that were expressly written as literature reviews; 
for example, Smith and Amato (2012) inquired about the impact of various accommodations on 
the assessment outcomes of students with visual impairments. Investigating test structure and 
identifying predictors of the need for accommodations were each fairly uncommon as a primary 
study purpose, each represented by less than 3% of the studies (n=1; test structure was primar- 
ily investigated in Posey & Henderson, 2012; identifying predictors was primarily identified in 
Brown, Reichel, & Quinlan, 2011). 


Table 2 provides a more detailed view of the accommodations research body of literature. It 
shows the multiple purposes of many studies. These multi-purpose studies contained up to 
four different purposes, but most commonly there were two purposes. For example, some ef- 
forts (Feldman, Kim, & Elliott, 2011; Kim, 2012; Patterson, Higgins, Bozman, & Katz, 2011; 
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Schmitt, McCallum, Hennessey, Lovelace, & Hawkins, 2012; Schmitt, McCallum, Rubinic, 
& Hawkins, 2011) included analyses of score comparisons between students with disabilities 
and students without disabilities when using accommodations, yet also studied perceptions by 
analyzing students’ comments through survey or interview about their test-taking experience. 


Table 2. All Purposes of Reviewed Research 


Proportion of Studies? 
Study/compare perceptions and preferences about use 


Compare scores 
only students with disabilities (20%) 
only students without disabilities (0%) 
both students with and without disabilities (22%) 


4The total of these percentages is >100% due to the multiple purposes identified in most (39) of the studies; 26 
of the studies had 2 identified purposes, 9 of the studies had 3 identified purposes, and 5 of the studies had 4 
identified purposes. 


When all purposes (i.e., primary, secondary) are included, the most common single purpose of 
the 2011-2012 published studies was inquiring from study participants about their perceptions 
of accommodations. The second most common purpose in this set of studies was demonstrat- 
ing the effect of accommodations on test scores. Study approaches either compared test scores 
of students with disabilities and students without disabilities when using accommodations, or 
compared test scores of students with disabilities when using and not using accommodations. 
Each of these approaches was used in about half of this category of research. These first two 
purposes were both investigated in many of the 2011-2012 studies (n=11; see Tables A-1 and 
A-2 in Appendix A). 


Another purpose we identified in almost one-third of the studies was summarizing research on 
test accommodations, when a substantive part of the document was devoted to a comprehensive 
review of accommodations and their effects. All of the dissertations (n=7) among these stud- 
ies, along with literature reviews, were identified with this purpose. Although not reported as 
a primary purpose, discussing issues was identified in almost one-third of the studies, usually 
noted when the researchers offered detailed considerations of central issues related to accom- 
modations. For example, Holmes and Silvestri (2012) presented information about availability 
of assistive technology for postsecondary students with disabilities. The purpose of reporting 
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on implementation practices and/or accommodations use was part of nearly one-fourth of the 
studies. For example, Qi and Mitchell (2012) detailed accommodations practice and use with 
the Stanford Achievement Test for deaf and hard-of-hearing children. 


The purpose of comparing test items co-occurred in some studies (n=4) on comparing scores 
between accommodated and non-accommodated tests adding a focus on analyzing differential 
item functioning (DIF). For instance, Flowers, Kim, Lewis, and Davis (2011) compared effects 
of oral delivery when provided on print tests and computerized tests, and also examined dif- 
ferential benefits of standard print format and computerized format on individual items. Addi- 
tionally, comparison of test items was part of studies that simultaneously considered construct 
validity. For example, Cho, Lee, and Kingston (2012) measured whether item characteristics 
were related to item difficulty, and also analyzed whether item functioning was related to use 
of an accommodations package to discern test validity. 


The least common purposes, evaluating test structure and predicting the need for accommoda- 
tions, were investigated by two studies each. An example of the former was when Posey and 
Henderson (2012) sought expert feedback in examining test features. An example of the latter 
was when Zebehazy, Zigmond, and Zimmerman (2012) analyzed the score patterns of students 
with visual impairments to discern the need for the accommodations that they received. 


Research Type and Data Collection Source 


About two-fifths of the accommodations research reviewed here used a quasi-experimental 
research design to gather data for their research purposes. As seen in Table 3, in over twice as 
many quasi-experimental studies (n=14), researchers themselves gathered the data (i.e., primary 
source data), compared to studies with secondary data sources (n=6), such as extant or archival 
data. The number of quasi-experimental research studies increased slightly in 2012 compared 
to 2011, while the number of studies using a descriptive quantitative design remained the same. 
Researchers reported using truly experimental studies only 2 times in 2011 and 3 times in 2012. 
Though few studies were reported to use descriptive qualitative, longitudinal, or meta-analytic 
designs, these categories also were rarely included in past reports. Furthermore, there appeared 
to be a small difference between data collection sources, with almost two-thirds of studies using 
primary sources and over one-third of studies using secondary sources of data. This is similar to 
the previous report in which a similar proportion of about twice as many studies used primary 
data in comparison with secondary data sources. 
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Table 3. Research Type and Data Collection Source by Year 


Research Design Data Collection Source Research 
Type Tools 


2012 


Quasi-experimental 
Descriptive quantitative 
Descriptive qualitative 


Data Collection Methods and Instruments 


The researchers collected study data that were gathered through primary or secondary proce- 
dures using various methods and tools, as seen in Figure 2. Most of the research (n=29; 59%) 
included in this synthesis for 2011-2012 used data acquired through academic content testing. 
About two-fifths (n=21) of the studies employed surveys to gather data. Interviews were used 
much less frequently. For this analysis, we considered “articles” the method or source for those 
studies that reviewed research, including one study that employed formal meta-analysis. Three 
studies used observations, and one study used focus groups as a data source. Over one-third of 
the studies reported using more than one method or tool to gather data. 


Nearly all of the 2011-2012 studies used data collection instruments of one form or another; 
only four studies did not employ any instruments. Table 4 presents the types of data collection 
instruments used in studies. Surveys presented items of an attitudinal or self-report nature. Tests 
were course- or classroom-based. Assessments were statewide or large-scale in scope. Proto- 
cols refer to nonacademic sets of questions, usually presented in an interview or focus group 
format. Measures referred to norm-referenced academic or cognitive instruments. All of these 
instruments were placed into five categories: protocols or surveys developed by study authors, 
norm-referenced cognitive ability measures, norm-referenced academic achievement measures, 
state criterion-referenced academic assessments, and surveys or academic tests developed by 
education professionals or drawn by researchers from other sources. Non-test protocols developed 
by the author or authors of the studies—the most commonly-used instrument type—included 
performance tasks, questionnaires or surveys, and interview and focus-group protocols, among 
others. Surveys or academic tests developed by education professionals or researchers used 
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Figure 2. Data Collection Methods Used in 2011-2012 Research 


Number of Studies 


Test es 29 
Suvey SI 21 
Interview — 7 
Articles (ES 7 


Observation [i 3 


Method 


Focus Group ff 1 


Multiple i 17 


Note. Of the 49 studies reviewed for this report, 14 reported using two data collection methods, and 3 reported 
using three data collection methods. 


sources outside of current studies, and were exemplified by perception surveys such as the Ac- 
cessibility Rating Matrix (ARM; Beddow, Elliott, & Kettler, 2009; as in Kettler, et al., 2012), 
or by subsets of items drawn from released or otherwise-available pools such as the Discovery 
Education Assessment (e.g., Beddow, 2011). 


State criterion-referenced assessments included those of Georgia, Maryland, Pennsylvania, and 
Virginia, as well as some from states that remained unidentified in the research. Nine norm- 
referenced academic achievement measures were used in one or more studies, including the 
TerraNova Achievement Test and the Nelson-Denny Reading Test (NDRT). Norm-referenced 
cognitive ability measures included the Clinical Evaluation of Language Fundamentals—Fourth 
Edition (CELF-4), among others. A substantial minority—16 studies in all—used instrumenta- 
tion of more than one kind. Additionally, a small number of studies used multiple instruments in 
each of them, often of the same kind (Brown et al., 2011; Feldman et al., 2011; Shelton, 2012; 
Srivastava & Gray, 2012). A small number (n=3) of instruments was used in more than one 
study: Clinical Evaluation of Language Fundamentals—Fourth Edition (CELF-4), the National 
Assessment of Educational Progress (NAEP), and Georgia’s Criterion-Referenced Competency 
Tests (CRCT) in mathematics. We present a complete listing of the instruments used in each of 
the studies in Appendix C, including the related studies that served as sources for these instru- 
ments, when available. 
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Table 4. Data Collection Instrument Types 


Instrument Type 


Number of Studies 


Non-academic protocols or surveys developed by study author/s 


23 


Surveys or academic tests developed by professionals or researchers 
using sources outside of current study 


20 


Norm-referenced academic achievement measures 


State criterion-referenced assessments 


Norm-referenced cognitive ability measures 


Other? 


None? 


BAIL M/RILO!O 


Multiple (types) 


15 


4Other: 1 study used an observation procedure (Bouck, Flanagan, & Joshi, 2011), 1 study used a college course 


exam (Makeham & Lee, 2012). 


> 4 studies were literature reviews employing various data collection approaches and/or instruments (Holmes & 


Silvestri, 2012; Lovett, 2011; Shinn & Ofiesh, 2012; Smith & Amato, 2012). 


Content Area Assessed 


A number of studies published during 2011-2012 focused on accommodations used in certain 
academic content areas. As shown in Table 5, math and reading were the two most commonly 


studied content areas. Table 5 also provides a comparison to content areas in NCEO’s previous 


reports on accommodations (Rogers et al., 2012; Cormier et al., 2010). In general, the emphasis 


on reading and math is consistent across reviews. The number of studies on writing, social stud- 


ies, and psychology has remained fairly consistent since 2005. An increase in science studies, 


apparent in previous years, was not evident in the current report, where there was a decrease 
in numbers. There have been no studies citing Civics/U.S. History since 2005-2006, so we did 


not include this content area in the current report. Two studies published in 2011-2012 did not 


specify a content area. This is a change from the last report, in which all studies specified the 


content areas of the assessments and their accommodations. 
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Table 5. Academic Content Area Assessed Across Three Reports 


Content Area Assessed 2007-20082 2009-2010" 2011-2012° 


Mathematics 


Writing 
Other Language Arts* 
Science 


4 Studies in 2007-2008 including examinations of more than one content area ranged in number of areas as- 
sessed from 2 to 4. 


> Studies in 2009-2010 including examinations of more than one content area ranged in number of areas as- 
sessed from 2 to 5. 


© Studies in 2011-2012 including examinations of more than one content area ranged in number of areas as- 
sessed from 2 to 4. 


‘Detailed descriptions of what constituted “Other Language Arts” for each of the two studies from 2011-2012 can 
be found in Appendix C, Table C-2. 


Research Participants 


Researchers drew participants from differing roles in education (see Figure 3 and Appendix 
D, Table D-1). A majority of research analyzed was studies that included only students—32 
of the 49 studies from 2011-2012. The next largest participant group studied was “educators 
only,” describing or analyzing the educator perspective on accommodations. The only other 
participant category occurred in one study that examined both educators and students. Unlike 
the previous report, in which two studies (Bayles, 2009; Jordan, 2009) included parents as re- 
search participants, there were no studies in 2011-2012 that did so. Five studies did not draw 
data from research participants. 
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Figure 3. Types of Research Participants 


Number of Studies 


Educators & Students | 1 


Educators only “4 11 


Participant Type 


Table 6 details the composition and size of the participant groups in the research studies pub- 
lished during 2011 and 2012; this information is displayed in more detail by study in Appendix 
D. The size of the participant groups varied from 3 (Bouck et al., 2011; Schmitt et al., 2011; 
Schmitt et al., 2012) to 769,550 (Gregg & Nelson, 2012). The numbers of participants appear 
evenly spread across the continuum between those numbers, as shown in Table 6. There were 
six studies with participant numbers ranging from 47,404 to 769,550. For the other 31 studies, 
participant numbers ranged from 3 to 7,010, with 28 of those studies having fewer than 1,000 
participants. Most of the studies had only student participants; of these 32 studies, 31 of them 
had participant count data available. The number of student participants in these studies ranged 
from 3 to 769,550; six studies had over 5,000 student participants each, and 25 of them had 
fewer than 1,000 student participants in each study. Of the other eleven studies with only edu- 
cators as participants (one study, Kuti, 2011, had both educators and students), seven studies 
had between 107 and 372 participants, with the remaining four studies having 12 participants 
(Hodgson, Lazarus, Price, Altman, & Thurlow, 2012), 56 participants (Koutsoftas & Gray, 2012), 
83 participants (Phillips, Terras, Swinney, & Schneweis, 2012), and 840 participants (Zhou, et 
al., 2012). In other words, studies with only educator participants tended to have much smaller 
sample sizes than studies with only student participants. 
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Table 6. Participant Sample Sizes and Ratio of Individuals with Disabilities 


Number of Research Number of Studies by Proportion of Sample Comprising 
Participants by Study Individuals with Disabilities 


Lal 


#1 study did not specify the proportion of participants who had disabilities. 


» 1 study did not specify the number of participants. 


In 2011-2012, there was a larger number of studies in which at least 50% of the participants were 
people with disabilities (n=18) than there were studies with fewer than 50% of the participants 
being people with disabilities (n=15); only one study did not have the number of participants 
available (Taherbhai et al., 2012). The six studies with between 25% and 49% people with dis- 
abilities had participant group sizes ranging from 39 to 1,944, and involved only student par- 
ticipants. Of the nine studies with fewer than 25% people with disabilities, six studies ranged 
in participant numbers from 282 to 769,550, and these six studies were focused on student as- 
sessment performance; further, four of these studies examined extant data sets of over 50,000 
students each. The other three studies in that set were focused on educators’ perceptions and 
knowledge of accommodations (Brockelmann, 2011; Phillips et al., 2012; Zhou et al., 2011). 
There were only three studies with 50% people with disabilities and 50% without disabilities, 
and they each had fewer than 50 participants, who were students. 


Fifteen studies examined participant groups composed almost entirely of people with disabili- 
ties; these are reported in the 75-100% column. In fact, 14 of these 15 studies focused only on 
students with disabilities. The exception was a study (Kuti, 2011) that engaged 8 educators in 
providing qualitative interview data and examined extant data from 7,002 students with dis- 
abilities. Of the studies involving more than 50% participants with disabilities, there were three 
distinct group sizes: fewer than 25, between 50 and 299, and over 4,000. Finally, almost all of the 
2011-2012 studies reported sufficient data to determine the proportion of study participants who 
had disabilities and who did not have disabilities. This observation substantially contrasts with 
information from the 2009-2010 studies, when about 25% of the studies did not have sufficient 
data to determine these proportions. However, unlike the previous reporting period which had 
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a complete accounting of the number of participants in the relevant studies, there was a study 
that did not publish the exact proportion of participants with disabilities, due to circumstances 
explained in that study (Patterson et al., 2011). 


School Level 


Research on accommodations published during 2011 and 2012 involved kindergarten through 
college-aged participants (see Table 7). Previous reports included research with participants in 
kindergarten through postsecondary (see Appendix D for more detail). Postsecondary included 
both university participants and participants in other postsecondary settings. For example, 
Thori (2012) investigated the perspectives of faculty members in two-year and four-year higher 
education institutions, and Gregg and Nelson (2012) gathered accommodated test scores from 
students transitioning from postsecondary settings to work settings. This shift toward including 
studies about accommodations in testing for postsecondary-aged youth began in the previous 
report (Rogers et al., 2012). 


As seen in Table 7, a plurality of the studies published in 2011 and 2012 focused on middle 
school students (n=21). Twelve studies involved elementary school students, and ten involved 
high school students. Nearly one-quarter of the studies (n=12) involved samples from across 
more than one grade-level cluster; nearly all of these studies included relatively larger groups 
of 50 or more participants (91%), and one-half of them used secondary data sources (see Ap- 
pendices B and D). Put another way, these multiple grade-level studies were either analyses of 
extant large-scale assessment data sets, often drawn at the state level, or examinations of data 
gathered by researchers under experimental and quasi-experimental conditions. Although not 
more common than K-12 studies, there was a noteworthy number of studies that examined ac- 
commodations use and implementation at the postsecondary/college level; further, some (n=2) 
of these involved adult learners who were not in formal higher education institutions. For ex- 
ample, Patterson and her colleagues (2011) piloted the General Equivalency Diploma (GED) 
mathematics test in a computerized form with accessibility tools to provide for adult learners’ 
accommodations needs. 


Table 7. School Level of Research Participants 


Education Level of Participants in Studies Number of Studies 
Elementary school (K-5) 


14 NCEO 


Disability Categories 


A broad range of disability categories was included in samples in the 2011-2012 research (see 
Appendix D for details). As shown in Table 8, seven studies did not specify disability categories 
of student participants, eleven studies did not include students in the sample, and five studies did 
not enumerate participants. Of the remaining 26 studies, the most commonly studied disability 
category was learning disabilities (n=17); five of these studies had only participants with learn- 
ing disabilities, and four more compared students with learning disabilities to students without 
disabilities. About one-fourth of these remaining 26 studies included students with blindness/ 
visual impairments (n=7), students with emotional behavioral disabilities (n=6), or students with 
speech/language impairments (n=6). About one-fifth of the 26 studies included students with 
deafness/hearing impairments (n=5), and another one-fifth included students with autism (n=5). 
The lowest proportions of studies—between one-sixth and one-eighth—included students with 
attention problems, students with physical disabilities, or students with intellectual disabilities. 
Only two studies reported participants with “multiple disabilities.”” Over one-half of relevant 
studies included students without disabilities as comparison groups. 


Besides students with learning disabilities, very few studies examined accommodations for only 
participants with one specific category of disabilities: students with blindness/visual impairments, 
2 studies (Kim, 2012; Posey & Henderson, 2012); students with hearing impairments, 1 study 
(Cawthon, Winton, Garberoglio, & Gobble, 2011); students with speech/language impairments, 
1 study (Koutsoftas & Gray, 2012); students with autism, 1 study (Alt & Moreno, 2012); and 
students with attention problems, | study (Brown et al., 2011). Eight studies included partici- 
pant groups with various disabilities, rather than all having one specific category of disability. 


Table 8. Disabilities Reported for Research Participants 


[Emotional behavioral dsabiliy —~—SC~sCSCSCSC~ CSS 
FSpeechitanguageSSSCSC~C“~“~idCSS 
[DeafnessiHearing impairment Si 


Autism 
Attention problem 
Physical disability? 


Multiple disabilities® 
No disability 

Not specified* 

Not applicable* 


Intellectual disabilities 


@ Physical disability = mobility impairments and/or impairment with arm use. 
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Table 8. Disabilities Reported for Research Participants (continued) 


> Multiple disabilities = individual students who were each specifically categorized as having more than one dis- 
ability. 


° Not specified = those studies or reviews (1) of studies that did not report about or provide detail as to the partici- 
pants’ disabilities. 


4 Not applicable = those documents that had only non-students as participants. 
Types of Accommodations 


The number of times specific categories of accommodations were included in 2011-2012 pub- 
lished research is summarized in Table 9. Presentation accommodations were the most frequently 
studied category (n=35), and within this category the most common accommodation was oral 
delivery—including human reader, and via technology (n=23). The next three most common 
presentation accommodations were computer administration (n=9), large print (n=8), and braille 
(n=7). The next most frequent category studied was response accommodations (n=23), and in 
that category, dictated response (n=11) was the most common accommodation. It should be 
noted that the computer administration accommodation fits into three categories: presentation, 
equipment/materials, and response. The next most common response accommodation was 
dictated response (n=8). 


Several studies (n=28) analyzed accommodations from more than one category. For example, 
Kim (2012) studied students with visual impairments who were provided the read-aloud accom- 
modation by a human reader, in addition to other accommodations including large print, braille, 
and extended-time. Two studies—Beddow (2011) and Fox (2012)—examined accommodations 
as they were naturalistically identified in students’ IEPs, and their effects were not individu- 
ally measured. Many of these instances of multi-category accommodations studies are related 
to the fact that some accommodations fit into more than one category. For example, studies 
examining computer administration (n=10) fit into three categories: presentation, equipment/ 
materials, and response. In contrast, fewer studies (n=13) investigated accommodations within 
the same category. In fact, nearly all of these studies (n=11) focused on single accommodations, 
and most of them studied either read-aloud (n=6) or extended-time (n=4). A complete listing of 
accommodations examined in each study is provided in Appendix E. 


Table 9. Accommodations in Reviewed Research 


Accommodation Category Number of Studies 
Equipment/Materials 


fseting —OCSC“sS~—C—‘“‘iSSC‘ 
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Research Findings 


The findings of the studies about accommodations published in 2011 and 2012 are summarized 
in Tables 10-20. We present information according to the nature of the studies, in keeping with 
the range of their purposes and focuses. The findings included sets of research about specific 
accommodations: oral delivery, computer administration, extended-time, calculator, and aggre- 
gated sets of accommodations commonly called “bundles.” We also report the findings about 
unique accommodations—those examined in only one study each—including a specialized 
calculator, American sign language (ASL) via digital video, word-processing, and visual chunk- 
ing representation. We also report about descriptions of perceptions about accommodations, 
including those of student test-takers as well as educators. We summarize the findings of the 
accommodations, and describe a range of implementation conditions as well as incidence of use 
of various accommodations across large data sets. The findings from studies in postsecondary 
educational contexts, which have grown over time from 6 or 7 in our past three reports to 11 in 
this report, are given separate attention. This report also presents findings by academic content 
areas: math, reading, science, and writing. In Appendix F, we provide substantial detail about 
individual studies. 


Impact of Accommodations 


Research examining the effects of accommodations on assessment performance for students 
with disabilities comprised 29 studies published in 2011 and 2012 (see Table 10; see also Ap- 
pendix F, Tables F-1 to F-6 for details about each study of this type). We detail the effects of 
these four discrete accommodations—oral delivery, computer administration, extended time, and 
calculator—along with lists of aggregated accommodations and uncommon accommodations. 


Oral delivery, provided using text-to-speech devices or human reader, was the single most 
investigated accommodation in 2011-2012 with six studies. For clarity in this report, we used 
“oral delivery” in place of “read aloud” to explicitly acknowledge the range of media formats 
used, including human readers, recordings of assessment items or instructions, and text-reading 
software or text-to-speech devices. The delivery methods that do not use human delivery of the 
accommodation have been increasing in research attention. 


Of the six studies examining oral delivery, three studies supported performance improvements 
for some students with disabilities but not all or in some testing conditions but not all. Lazarus, 
Thurlow, Rieke, Halpin, and Dillon (2012) noted no average score differences for the 24 par- 
ticipants as a whole when using and not using a human reader, yet found that individual scoring 
patterns indicated that seven participants scored higher when using read-aloud, eight scored 
higher when not using read-aloud, and nine scored the same under both conditions. Schmitt 
and colleagues (2012) found that the three college student participants with reading disabilities 
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varied in degree of score improvement on reading comprehension, when using a ReadingPen 
Advanced Edition (2006) device with a digitized voice. Comparing each student’s scores under 
a control condition, when using the device for only decoding, and for decoding and seeking 
vocabulary definitions, researchers indicated that the student with lowest comprehension skills 
benefited most in both reading pen conditions in contrast to the other students, who scored better 
when not using the accommodation. The same least-skilled individual student benefited more 
from the reading pen’s decoding support than from using it for both decoding and vocabulary 
definition. In a similar study, which measured comprehension accuracy and comprehension 
rate per minute, Schmitt and colleagues (2011) found that high school students with learning 
disabilities using a ReadingPen Advanced Edition (2006) device to decode words and to define 
vocabulary words scored worse on rate than when using it to decode words only. Two of the 
three participants scored highest on accuracy without the accommodation. The other three oral 
delivery findings seemed at odds with one another. Shelton (2012) found that audio-recorded 
oral delivery supported score improvements for both students with and without (learning) 
disabilities. Kim (2012) found that students with disabilities (visual impairments) scored dif- 
ferentially better with support of an human reader. Holmes and Silvestri (2012) summated that 
the studies on assistive technology (AT) indicated that text-to-speech supported reading, and 
also provided additional benefits, such as improvement in comprehension, task persistence, and 
reading rate. (See Appendix F, Table F-1.) 


Computer administration, which is both a presentation and response accommodation, was the 
next most frequently-studied accommodation in the 2011-2012 published literature, comprising 
one-seventh of the effect studies (n=4). Most of the study findings (75%) indicated that use of 
computer administration as a stand-alone accommodation (i.e., it was not bundled with other 
accommodations), did not result in higher performance for students with disabilities. This result 
occurred for youth and adults completing the General Equivalency Diploma exam (Patterson, 
Higgins, Bozeman, & Katz, 2011), grade 8 students with and without language-learning disabili- 
ties completing reading comprehension assessments (Srivastava & Gray, 2012), and students in 
grades 7 and 8 with learning disabilities matched with similar-ability students without disabilities 
completing reading and math state assessments (Taherbhai, Seo, & Bowman, 2012). The study 
(Alt & Moreno, 2012) that differed in findings from these three studies compared test formats 
for age 5-13 year old students with and without autism spectrum disorders on expressive and 
receptive language and found that students with disabilities did not differentially benefit from 
computerized test format when comparing their scores with those of students without disabilities, 
who were matched for age and sex. (See Appendix F, Table F-2.) 


The extended-time accommodation was investigated in three studies (Brown, Reichel, & 
Quinlan, 2011; Gregg & Nelson, 2012; Lovett, 2011). The findings about the effect of extended 
time on assessment scores varied widely, yielding no consensus. One study (Brown et al., 2011) 
indicated that extended time supported improved reading comprehension scores for students 
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with attention deficit hyperactivity disorder (ADHD). A meta-analysis (Gregg & Nelson, 2012) 
indicated that studies published from 1986 through 2006 supported the differential boost hy- 
pothesis, that is, students with disabilities scored significantly better with extended time than 
without, and had differentially greater score gains than did students without disabilities using 
extended time (in comparison with their standard performance). In contrast, one study (Lovett, 
2011) reported that students without disabilities improved scores in a similar manner to students 
with disabilities. (See Appendix F, Table F-3.) 


Effects of the calculator accommodation were explored in three studies. Two studies yielded 
the conclusion that all students, both with and without disabilities, improved in performance 
on a math state assessment when using calculator as an accommodation (Engelhard, Fincher, 
& Domaleski, 2011) or as a modification (Randall, Cheong, & Engelhard, 2011). In addition, 
item-level analyses of extant state math assessment data demonstrated that the benefit of the 
calculator use for students with disabilities was complicated by the relative difficulty of the 
items. On items that had low difficulty, due to requiring lower-level skills such as operation and 
number sense, students with disabilities benefited when using calculators on these easier items. 
In contrast, students with disabilities not using calculators performed better on items requiring 
higher-level skills. (See Appendix F, Table F-4.) 


Two studies examined effects of resource guides on assessment performance. In one study, 
Engelhard and colleagues (2011) conceptualized the resource guide as expressly not providing 
information that would affect the construct being tested, but instead provided scaffolding sup- 
ports that could assist students with disabilities with eliminating construct-irrelevant barriers 
to assessment. The study results indicated that the resource guide did not support an improve- 
ment in math assessment performance, either for students with disabilities, or students without 
disabilities (Engelhard et al., 2011). In the other study, Randall and colleagues (2011) used the 
term “modification” when referring to the resource guide. The study results yielded that both 
students with disabilities and students without disabilities performed better when using the 
resource guide modification than when not using it, with no differential benefit for either group 
of students (Randall et al., 2011). 


Researchers in five studies scrutinized effects of different aggregated sets of accommoda- 
tions—also called accommodations packages or bundles. These studies used five different 
aggregations of accommodations, and the effects of their uses during assessment were also 
divergent. One study (Feldman, Kim, & Elliott, 2011) indicated that use of various accom- 
modations packages individualized to students with disabilities during a reading/language arts 
achievement test supported score improvements for both students with and without disabilities 
in an equal manner. Another study’s results yielded that different accommodations packages 
supported improved scores for students with disabilities (Flowers, Kim, Lewis, & Davis, 2011; 
Kim, 2012). Flowers and her colleagues (2011) studied effects on test performance of students 
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with disabilities in grades 3-11, when using an oral delivery accommodation via text-to-speech 
software, in combination with a computerized or print format, on state assessments in reading, 
science, and mathematics. Examining effect sizes, the researchers found no differing results 
between or across grade levels, but did note that there were larger effect sizes for reading than 
for math. In addition, there were small to moderate effect size differences that tended to favor 
the printed text with human reader accommodations package. 


In a study examining sets of accommodations and modifications, termed enhancement packages, 
Kettler and his colleagues (2012) concluded that the collection of assessment enhancements 
supported improvements in science assessment performance for both students with disabilities 
and students without disabilities. Additional analyses indicated that only 7 of the 40 items 
demonstrated a differential boost, and 11 showed a minimal differential boost. The researchers 
indicated that some enhancements did not seem to benefit test-takers while others did, making 
the results unclear overall (Kettler et al., 2012). Finally, Kim (2012) found that when human 
readers provided the accommodation along with large print, braille, and extended time, students 
with visual impairments scored better in reading comprehension (in Korean language, in South 
Korea) than when using these other accommodations without read aloud. (See Table 10 for 
detail about findings of each study; also, see Appendix F, Table F-5.) 


We classified five studies as having investigated the impact of unique accommodations (i.e., ac- 
commodations that were the focus of just one study during the two years included in this report). 
Two studies reported that the unique accommodations did not support improved performance for 
students with disabilities: the voice input, speech output (VISO) calculator (Bouck, Flanagan, 
& Joshi, 2011) and American sign language (ASL) presented by an interpreter on digital video 
(Cawthon, Winton, Garberoglio, & Gobble, 2011). The former study investigated the VISO 
calculator’s impact on mathematics test behavior, and the latter study inquired about ASL via 
DVD for test directions and ASL via DVD for test items, and the possibility of different effects 
on reading and math achievement measures. Two unique accommodations—word processing 
(Holmes & Silvestri, 2012) and visual chunking representation (VCR; Zhang, Ding, Stegall, & 
Mo, 2012)—supported improved performance for students with disabilities. The effects of word 
processing on written products at the postsecondary level, and the literature review, indicated 
that the outcomes were improved spelling error detection, higher grade point averages, and 
increased course-completion rates for students with learning disabilities to a level equivalent to 
that of students without disabilities (Holmes & Silvestri, 2012). Visual chunking’s purpose was 
to support the visual memory of grade 3 students with math-related disabilities, and geometry 
assessment scores improved significantly when using VCR (Zhang et al., 2012). Finally, one 
study (Kettler et al., 2012) provided evidence about three unique enhancements (i.e., shorter 
item stems, bulleted text, simplified graphics). When examined separately, shorter item stems 
supported improved performance for all students, and bulleted text and simplified graphics did 
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not support improvements for either students with disabilities or students without disabilities. 
(See Table 10 for detail about findings of each study; also, see Appendix F, Table F-6.) 


Table 10. Summary of Research Findings by Specific Accommodation (n=23) 


Accommodation Number of 
Studied (total) Studies 
FREQUENTLY-STUDIED 


The oral-delivery accommodations supported improve- 
ment in assessment performance for some but not all 
students with disabilities or in some but not all testing 
conditions 


Oral delivery (5) The oral-delivery accommodation supported improved 
assessment performance and in other ways beyond for 
students with learning disabilities 


The oral-delivery accommodation supported improved 
assessment performance of all students 


The computer administration accommodation did not 
support improved scores for students with disabilities 
Computer adminis- | More than the paper assessment format 


tration (3) The computer administration accommodation did not | | 
support improved assessment performance for all 1 
students 


The extended-time accommodation supported im- 
proved scores for students with disabilities 


The extended-time accommodation supported score 
Extended time (3) improvements differentially for students with disabilities 
compared to those of students without disabilities 


The extended-time accommodation supported im- 
proved scores for all students 
The calculator accommodation supported improved 
performance for all students 

Calculator (2) 
The calculator accommodation had mixed results for 
students with disabilities 
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Table 10. Summary of Research Findings by Specific Accommodation (continued) 


Accommodation Number of 
Studied (total) Studies 


Accommodations package supported improved scores 
for all students in an equal manner (Package: any 
combination of the following: unlimited time, highlight- 
ing test directions, read-aloud directions only, test 
books in large-print format, student dictation to a hu- 
man scribe, and allowing frequent rest breaks) 


An accommodations package supported improved 
scores for students with disabilities more than another 

Aggregated set (3) accommodations package (Packages: computerized 
vs. print format, with oral delivery accommodation via 
text-to-speech software AND oral delivery accommo- 
dation via human reading aloud in combination with 
large print, braille, and extended time) 


Accommodations package supported improved scores 
for students with disabilities (Package: oral delivery 
accommodation via human reader in combination with 
large print, braille, and extended time) 


UNCOMMON / UNIQUE 


Voice-input, speech 


output (VISO) calcu- : ; 
lator The unique accommodations did not support improved 


- - performance for students with disabilities 
ASL via DVD for di- 
rections and items 
Word processing 


Visual chunking 

representation to The unique accommodations supported improved per- 
support working formance for students with disabilities 

memory for visual 

images 

The unique enhancement did not support improved 
performance for all -- students with disabilities as well 
as students without disabilities 


Shorter iemcrené The unique enhancement supported improvements dif- 1 
ferentially for a subset of students with disabilities 


Aulletsae and The unique enhancement did not support improve- 
: vee : ments differentially for a subset of students with dis- At 
simplified graphics 


abilities 


Math resource 
guides 


Perceptions about Accommodations 


Table 11 shows the set of 25 findings from 24 studies on perceptions about accommodations or 
modifications. Over one-half of the perceptions studies (n=13) reported on student perceptions 
only, while a slightly smaller proportion (46%) reported on educator perceptions only; one 
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study (Flowers et al., 2011) examined the perceptions of both educators and students. Studies 
on student perceptions found that students viewed accommodations or modifications as helping 
them perform better on assessments (Beddow, 2011; Kettler et al., 2012; Lazarus et al., 2012; 
Zhang et al., 2012), and supported them while taking assessments by benefiting them in some 
other way (Bouck et al., 2011; Feldman et al., 2011; Patterson et al., 2011; Shelton, 2012). Three 
studies (Makeham & Lee, 2012; Schmitt et al., 2012; Schmitt et al., 2011) found that there were 
conflicting views among student participants about unique accommodations, such as the iPod 
aural presentation and the “reading pen.” Some students indicated that using an 1Pod to access 
test items was beneficial and supported understanding through intonation and pacing; others 
indicated that this unique oral-delivery medium provided little or no benefit (Makeham & Lee, 
2012). For the reading pen, some indicated that they enjoyed using this tool, and slightly fewer 
indicated the opposite. Each study had only three participants. Schmitt and colleagues (2012) 
found a pattern in student perception: the least-skilled test-taker expressed the least satisfac- 
tion from using the reading pen. Finally, two studies (Bolt et al., 2011; Kim, 2012) observed 
that students preferred some accommodations over others. For example, students with visual 
impairments preferred to use oral delivery accommodations along with braille or magnifica- 
tion rather than using only braille or magnification; alternately, students without disabilities 
predominantly preferred not to use oral delivery because their reading speed was quicker than 
the human reader’s speed (Kim, 2012). 


The studies on educators’ perceptions of accommodations or modifications predominantly found 
that these enhancements to assessments were beneficial to student test-takers’ performance 
(hori, 2012; Leyser, Greenberger, Sharoni, & Vogel, 2011; Lipscomb, 2012) and to students’ 
motivation and endurance (Hodgson et al., 2012). Only one study (Meadows, 2012) indicated 
that some educators had less than favorable attitudes about accommodations. Meadows found 
that educators with less than a Master’s degree credentials and little teaching experience had less 
positive and supportive attitudes toward using assessment accommodations than other educa- 
tors. Four studies reported about educators’ knowledge of and familiarity with accommodations. 
Three of these studies (Phillips et al., 2012; Zhou et al., 2012; Zhou et al., 2011) indicated a wide 
continuum of knowledge and familiarity among study participants in each study, including little 
or no certainty about their capabilities and relatively high degrees of confidence in their capa- 
bilities. In contrast, one study (Davis, 2011) yielded a narrower range of perceived knowledge 
of accommodations, in that participants reported only moderate to high levels of knowledge, 
with no participants having little or no accommodations knowledge. The researchers identified 
various factors mitigating knowledge and familiarity: depending on the accommodations cat- 
egories (Davis, 2011) or the specific accommodations (Zhou et al., 2011), on the application of 
accommodations —such as instruction or assessment (Zhou et al., 2012), and on the number 
of instances of providing accommodations to students in an online class format (Phillips et al., 
2012). The finding of perceptions from both the students’ and educators’ perspectives asserted 
that students preferred the accommodations package of computerized format with text-to-speech 
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software over the package of printed text format with human reader; nevertheless, the assess- 
ment results did not support better performance using that package (Flowers et al., 2011). (See 
Appendix F, Table F-7 for more detailed explanation of findings of each study.) 


Table 11. Summary of Research Findings on Perceptions about Accommodations (n=24) 


Number of 
Studies 


Students 


13 
Students indicated that using accommodations or modifications benefited them A 
in terms of performance score 
Students indicated that using accommodations benefited them beyond perfor- A 
mance score improvements 

1 


Study Findings 


Student perceptions were mixed about the accommodations studied 


Students expressed a preference for one accommodation over one or more 
others 


3 
2 
Educators 1 
3 
3 


Educators had similarly positive or supportive attitudes about accommodations 
or modifications 


Educators had varying degrees of positive or supportive attitudes about accom- 
modations or modifications 


Educators indicated that they had various levels of familiarity or knowledge 
about accommodations 


Educators indicated that using accommodations benefited students beyond 
performance score improvements 


Educators indicated that they had moderate to high levels of knowledge about 
accommodations 


Educators and Students 1 
1 


Participant groups had similar perspectives about accommodations provided 


Implementation and Use of Accommodations 


Table 12 displays a summary of the 13 studies that reported 13 findings on incidence of ac- 
commodations use and implementation-related matters. The nature and outcomes of this set of 
studies were divergent overall, yet we identified some commonalities. In a few studies (Davis, 
2011; Thori, 2012, Phillips et al., 2012), researchers noted that implementation challenges and 
atypical use patterns affected accommodations practices. For instance, about 20% of post- 
secondary faculty participants expressed disagreement with the practice of providing specific 
response accommodations for students with ADHD (Ihori, 2012), and implementation barriers 
and facilitators were associated with training as well as educators’ demographics and grade 
levels of instruction (Davis, 2011). Researchers of three studies (Fox, 2012; Kim, 2011; Smith 
& Amato, 2012) reported that students with visual impairments were typically provided large 
print and extended-time accommodations, among others, on reading assessments. Fox (2012) 
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added that other popular accommodations for this group of students with disabilities were small 
group and individual or separate room settings, and Smith and Amato (2012) clarified that most 
states also offered lighting adjustment as an accommodation. 


In contrast with the previous report which noted that five studies observed that the most com- 
mon accommodation for students with disabilities was small group administration, the current 
set of studies had a consensus of only two studies indicating that the most common accom- 
modation for students with disabilities was extended time (Bolt, Decker, Lloyd, & Morlock, 
2011; Lovett, 2011). Two studies (Hodgson et al., 2012; Holmes & Silvestri, 2012) elaborated 
implementation variations that oral-delivery accommodations have had, including co-occurring 
accommodations offered in combination with oral delivery, the considerations of providing the 
accommodation during math assessments (Hodgson et al., 2012), and the functions that text-to- 
speech software can offer during reading and writing assessments (Holmes & Silvestri, 2012). 
Individual findings were also provided in three other studies (Shinn & Ofiesh, 2012; Cawthon, 
2011), including that students with hearing impairments are most often provided sign language 
and extended-time (Cawthon, 2011). (See Appendix F, Table F-8 for more detailed explanation 
of findings of each study.) 


Table 12. Summary of Research Findings on the Implementation of Accommodations (n=13) 


<fhus Number of 
Study Findings ; 
Studies 
Implementation challenges and atypical use patterns affected accommodations 3 
practices 
Common accommodations for students with visual impairments on reading 3 
included large print and braille and extended-time 


The most common accommodation provided to students with disabilities was 5 
extended time 


The oral-delivery accommodation has had variations in its implementation 


Various factors complicated the provision of accommodations to students at the 1 
postsecondary level 

Common accommodations for students with hearing impairments included sign 1 
language interpretation and extra time 


Accommodations use patterns differed among students with visual impairments 


In Table 13, we report on the seven studies providing seven findings about academic construct 
validity when accommodations were used on state assessments. Two studies resulted in there 
being no effect of the accommodation on academic construct for reading (Posey & Henderson, 
2012) and for reading, science, and mathematics (Flowers et al., 2011). Posey and Henderson 
(2012) reported that students with visual impairments using contracted braille performed simi- 
larly to students without disabilities not using accommodations. Also, when comparing a newer 
computerized test using text-to-speech software to the print format using a human reader, Flow- 


NCEO 25 


ers and colleagues (2011) determined through differential item functioning (DIF) analyses that, 
despite various differences on some items, there were no patterns showing that either format 
condition was favored more frequently than the other. Another study (Lovett, 2011) yielded an 
opposite result: extended time was shown in this review of the literature to have changed the 
meaning of students’ assessment performance. Further, item-level analyses using two different 
analysis approaches were conducted in another study (Randall, Cheong, & Engelhard, 2011). 
Randall and colleagues found that two problem-solving items included in a group of 10 items 
functioned differently under certain conditions. One problem-solving item was differentially 
more difficult for students with disabilities than for students without disabilities when presented 
without modifications, yet it was easier for students with disabilities when using the calculator 
modification. The other problem-solving item was found to be differentially easier for students 
without disabilities than for students with disabilities both with the calculator modification and 
with no modifications; the statistical significance of this finding differed between analysis ap- 
proaches. 


Two studies (Cho et al., 2012; Scarpati, Wells, Lewis, & Jirka, 2011) addressed the nuances of 
validity research, noting that various factors can complicate research results. Cho and colleagues 
(2012) reported that an accommodations package of read aloud, frequent breaks, and separate 
quiet setting improved scores for students with disabilities on some specific items, yet that stu- 
dents’ ability levels affected the degree of benefit from the accommodations package. Scarpati 
and colleagues indicated that both the difficulty level of individual items and the ability level 
ranges of students with disabilities can complicate research results. As Scarpati and colleagues 
noted, “students using calculators fared better on easier items whereas the nonaccommodated 
group fared better on more difficult items” (p. 60). Put another way, students using calculators 
did not derive any benefit from the accommodation when answering more difficult items un- 
less the students also had higher math abilities. (See Appendix F, Table F-9 for more detailed 
explanation of findings of each study.) 


Table 13. Summary of Research Findings Pertaining to Accommodations and Modifications 
Validity (n=7) 


oa ot Number of 
Study Findings ; 
Studies 


The accommodations did not change the construct 


The accommodations/modifications changed the construct 
Construct validity was affected by other factors 
The manner of scoring changed the construct/s being tested 
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Accommodations in Postsecondary Education 


In Table 14, we present a set of 15 findings from 11 studies that examined accommodations 
provided in educational settings beyond the K-12 school setting. Researchers investigated ef- 
fects of accommodations on test performance, test-takers’ experiences using accommodations, 
and faculty members’ perceptions of accommodations, along with implementation practices and 
uses of accommodations; three studies each reported findings in two of these areas. The five 
studies (Gregg & Nelson, 2012; Gregg, 2012; Holmes & Silvestri, 2012; Posey & Henderson, 
2012; Schmitt et al., 2012) examining accommodation effects included three literature reviews 
investigating multiple accommodations, as well as a study on contracted braille (Posey & Hen- 
derson, 2012) and a study on the reading pen (Schmitt et al., 2012). Gregg (2012) included a 
review of 32 studies about accommodations on testing for adult basic education learners. Over 
half (57%) of the studies examined effects of accommodations on university admissions test- 
ing. Nearly all (n=29) analyzed impacts of the extended-time accommodation, indicating that 
people with learning disabilities gained benefits. 


The meta-analysis (Gregg & Nelson, 2012) focused on the effects of extended time for people in 
transition from secondary education, namely postsecondary students and youth with disabilities 
in work settings. The findings were mixed in the nine studies analyzed, five of which specifically 
examined effects on university admissions testing. Study participants scored significantly higher 
in all three studies comparing the extended-time condition to the non-accommodated condition, 
with medium to large effect sizes. In the two studies comparing performance of youth without 
disabilities when accommodated and not accommodated, they performed moderately better with 
accommodations, with small to large effect sizes. According to two studies, the extended-time 
accommodation provided a differential boost for scores of students with disabilities compared 
to those of students without disabilities. Additional explanations of the moderator variables, 
including academic content and type of test, were also reported in detail for those two sets of 
studies of a sufficient number. 


Holmes and Silvestri (2012), in reporting about effects of assistive technology to support post- 
secondary students with learning disabilities, noted that there have been few studies on academic 
outcomes; they identified two studies that found that word-processing helped postsecondary 
students to improve spelling error detection, to increase GPAs, and to complete courses at a rate 
similar to the rate of students without disabilities. Posey and Henderson (2012) reported that 
contracted braille work-based reading skills scores for students with visual impairments were 
equivalent to the scores without the accommodation for students without disabilities. Schmitt and 
colleagues (2012) reported that the student with the lowest comprehension level demonstrated 
the most benefit from the reading pen (with digitized voice) from among the three students with 
reading disabilities, while the other two students’ reading comprehension scores decreased with 
the use of both forms of the accommodation from their scores without it. Further, the lowest- 
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performing student performed better when using the decoding-only function in comparison to 
using the decoding and vocabulary definition functions. 


The four studies reporting postsecondary faculty perceptions of accommodations (Brockelmann, 
2011; Thori, 2012; Phillips et al., 2012; and Posey & Henderson, 2012) yielded a variety of 
perspectives and ideas, partly related to their identities and roles, and other setting dynamics. 
All faculty participants in one study (Brockelmann, 2011) used similar numbers of accommo- 
dations during course examinations, but faculty in science, technology, engineering, and math 
(STEM) programs employed extended-time, individual setting, and exam formats—including 
read-aloud, dictated, typed, or scribed—more frequently than non-STEM faculty members, and 
STEM faculty regarded extended time as more effective than non-STEM faculty. Another study 
(hori, 2012) found no significant differences across faculty members in attitudes and beliefs 
about students with Attention Deficit Hyperactivity Disorder (ADHD), knowledge of legal 
protections for this group, and willingness to accommodate them, based on institutional setting 
(i.e., two- or four-year institution, public four-year or private four-year institution). 


Phillips and her colleagues (2012) surveyed a subset of faculty at one state public institution, 
those who teach online courses, and found that only one-third of participants (34%) felt capable 
of providing accommodations to students with disabilities, and that less than one-fourth (24%) 
had actually done so before, including extended time, alternate test formats, and assistive tech- 
nology. The researchers also provided a list of disability categories and accommodations that 
faculty reported having provided. Posey and Henderson (2012) reported educators’ suggestions 
for improving testing administration to support adults in basic education to access testing. 


Postsecondary students offered their perceptions about accommodations in testing in three studies 
(Bolt et al., 2011; Makeham & Lee, 2012; Schmitt et al., 2012). The findings of each study were 
unique, and we found little pattern to them as a group. Bolt and colleagues (2011) reported that 
the postsecondary students indicated that dictated response to a scribe and word processor with 
spell check were most helpful to them in the university setting, which were different from the 
most helpful accommodations during high school, which were extended-time and dictionary, 
along with dictated response to a scribe. The students varied in their experience of barriers to 
accommodations use, with about one-third (36%) identifying system-level issues, such as ac- 
cessing support and selecting appropriate accommodations; on the other hand, about one-third 
(34%) of students indicated that facilitators of accommodations use were other individuals, and 
another one-third (32%) credited system-level issues. 


Makeham and Lee (2012) indicated that most participants endorsed a strong preference for using 
oral-delivery accommodations via iPod in comparison with a human reader, and all participants 
expressed social discomfort, including embarrassment, when offered exam readers. In contrast, 
half of the participants reported that the iPod accommodation did not benefit them personally, 
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and that any form of oral delivery would be similarly not helpful. Schmitt and colleagues (2012) 
reported that although the lowest-skilled participant benefited most from using the reading pen, 
that participant also indicated the lowest degree of satisfaction with the experience. The three 
studies (Bolt et al., 2011; Holmes & Silvestri, 2012; Shinn & Ofiesh, 2012) also had a diversity 
of findings. Focusing on 14 accommodations of interest, Bolt and colleagues (2011) indicated 
that the most frequently-used accommodation for a group of postsecondary students was ex- 
tended time; they indicated that they also used the accommodation most often in high school. 


In a literature review, Holmes and Silvestri (2012) reported that software programs used during 
computerized assessments in reading provided supports such as text-to-speech, optical character 
recognition (OCR), and synthesized speech, and computerized writing assessments supported 
students with speech- or voice-recognition, word prediction, and mind mapping and outlining. 
Shinn and Ofiesh (2012) described both universal design and accommodations solutions for 
postsecondary students; to address access demands, they identified font size and text-to-speech 
software, among others; to address output demands, extended time, word processing and key- 
board composition via computer access, and dictation software. Finally, Posey and Henderson 
(2012) reported that reading skills constructs were essentially the same for students with visual 
impairments using contracted braille during an assessment as they were for students without 
disabilities not using accommodations, in that both groups achieved similar results. (See Ap- 
pendix F, Table F-10 for more detailed explanation of findings of each study.) 


Table 14. Summary of Research Findings on Accommodations at the Postsecondary Level 


ee Number of 
Study Findings i 
Studies 
Postsecondary student performance 
Postsecondary faculty perceptions 


Postsecondary student perceptions 
Postsecondary accommodations practices/uses 
Postsecondary accommodations validity 


Accommodations by Academic Content Assessments 


As in the previous report, we analyzed findings according to academic content area that was 
the focus of the research. Employing this approach recognized that many accommodations are 
associated with specific academic content. Some examples of these cases include: calculators 
for math and science assessments, and word processing for writing assessments or constructed 
responses on reading, other English language arts (ELA) assessments, and science assessments. 
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Some accommodations, such as oral delivery, may be presented differently depending on the 
academic construct being assessed. 


We present findings for each content area here according to the frequency with which the content 
areas were identified in the set of 49 research studies reviewed, with most prevalent content 
areas presented first: 28 findings from 20 studies in mathematics, 26 findings from 15 studies 
in reading, 9 findings from 3 studies in science, and 5 findings from 4 studies in writing (see 
Figure 4). Analysis of findings for each content area are the same as those we employed earlier 
in this report, including the impact of accommodations on assessment performance, percep- 
tions about accommodations, construct validity of accommodated assessments, and matters of 
implementation and instances of use of accommodations. 


Figure 4. Research Findings by Content Area 


Number of Findings 


Reading as 2 
Science Po 9 
Writing Es 5 

Multiple Content Ea 16 


Content Area 


Note: The number of findings does not equate with the number of studies, because many studies reported more 
than one finding. 


Mathematics. Table 15 displays the 28 research findings for accommodations from 20 studies 
of mathematics assessments, organized according to research type and participant populations 
then sorted by frequency according to the nature of the individual findings. The findings were 
diverse, represented by small numbers of studies for each finding, and with little agreement 
across the findings. Effects of accommodations on performance comprised the most frequent 
type of finding, with 12 findings from 11 studies. Eleven different effects of accommodations 
or modifications were reported in these 12 findings; calculator use was the only accommodation 
reported in more than one finding. The 10 accommodations were: voice-input speech-output 
calculator, American sign language (ASL), oral delivery, basic functions calculator, computer- 
ized format, visual chunking representation, math resource guides, extended time, various and 
multiple accommodations, and unique accommodations packages; and the one modification 
was: shortening the item stem. 
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Of the 12 findings, 7 of them pertained to effects for students with disabilities, and 5 pertained 
to effects for all students. The most common individual finding, supported by three studies, was 
that accommodations did not facilitate improved test performance in math for students with dis- 
abilities; this was found for voice-input speech-output calculator (Bouck et al., 2011), various and 
multiple accommodations (Cawthon, Kaye, Lockhart, & Beretvas, 2012), and ASL (Cawthon et 
al., 2011). Another finding, supported by two studies, indicated that accommodations—includ- 
ing oral delivery (Lazarus et al., 2012) and basic calculator (Scarpati et al., 2011)—had mixed 
results for students with disabilities, supporting score improvements for some items and not 
for other items. The last finding supported by more than one study was that accommodations, 
including basic calculator (Engelhard, Fincher, & Domaleski, 2011) and computerized format 
with online-delivered accommodations (Patterson et al., 2011), did not support math score 
improvements for either students with or without disabilities. The remaining five findings were 
unique to one study each, and not supported by other studies; two of these findings pertained 
to effects for students with disabilities, and three findings pertained to effects for all students 
(See Appendix F, Table F-11 for details of the individual study findings.) 


Perceptions of accommodations used during math assessments comprised another set of find- 
ings; these six findings were identified in six different studies. Although these findings were 
categorized by whose perceptions were examined—students or educators, or both, most of 
the findings (n=4) indicated that the various accommodations were perceived as beneficial to 
students in terms of their math assessment performance (n=2; Beddow, 2011; Lazarus et al., 
2012) or had some other benefit beside math score (n=2; Patterson et al., 2011; Hodgson et al., 
2012). The other two findings indicated that students expressed preferences for one version of 
an accommodation (Zhang, Ding, Stegall, & Mo, 2012) or set of accommodations (Flowers et 
al., 2011) over a different accommodation or set. The enhancements reported in these six per- 
ception findings numbered five in all, and included accommodations such as oral delivery (in 2 
studies; Lazarus et al., 2012; Hodgson et al., 2012), computerized format with online-delivered 
accommodations (Patterson et al., 2011), visual chunking representation (Zhang et al., 2012), and 
computerized format (Flowers et al., 2011), along with various modifications (Beddow, 2011). 


Finally, researchers in three studies reported five findings about patterns of use of specific math 
accommodations and accommodations practices. A finding on use patterns indicated that oral 
delivery was provided on math assessments to students with disabilities as a group more often 
than many familiar accommodations, such as breaks and calculators (Flowers et al., 2011). 
Another use finding was that students with visual impairments most often received large print 
during math (and reading) assessments, and others were nearly as frequent, like small group or 
individual and extended time (Fox, 2012). The last use pattern findings distinguished between 
students with visual impairments who had more and less functional vision. In general, students 
using more vision for math (and reading) assessment tasks received fewer accommodations, 
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but some students with less vision sometimes received fewer or no accommodations than other 
low-vision peers (Zebehazy et al., 2012). 


The findings on accommodations practices pertained to oral delivery as it was offered during 
state assessments. Oral delivery was administered in various ways, and implemented differently 
during math assessments. Oral delivery was provided by human readers to individual students 
or to small groups with similar pacing needs. Several researchers pointed out that this accom- 
modation was provided in combination with other accommodations due to circumstances (e.g., 
reading aloud during assessment administration required a separate setting and frequent breaks) 
rather than as a function of students’ needs on their individual education program (IEP) plans 
(Flowers et al., 2011). The math accommodations reported in the five studies that included use 
and practices findings were oral delivery (Flowers et al., 2011), large print, setting based, and 
extended time (Fox, 2012), and various vision-related accommodations (Zebehazy et al., 2012). 
(See Appendix F, Table F-11 for more detailed explanation of findings of each study.) 


Table 15. Summary of Research Findings on Accommodations in Mathematics Assessments 
(28 findings from 21 studies) 


eee Number of 
Study Findings 
MATH PERFORMANCE EFFECTS 
Students with Disabilities 


Accommodations did not support improved math performance for students with 3 
disabilities. 

Accommodations had mixed results on math assessments for students with 2 
disabilities. 

Accommodations supported improved math performance for students with dis- 
abilities. 


Accommodation set supported improved math performance for students with 
disabilities more than another accommodation set. 


Accommodation did not support improved math performance for either students 
with disabilities or students without disabilities. 


Accommodation provided differential benefits in math performance scores of 
students with disabilities compared to those of students without disabilities. 


A unique modification supported differential benefits for a subset of students 
with disabilities who were eligible for modified math assessments. 


PERCEPTIONS OF ACCOMMODATIONS IN MATH 
Students/test-takers 


Students indicated that using accommodations or modifications benefited them 2 
in terms of math performance score. 
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Table 15. Summary of Research Findings on Accommodations in Mathematics 
Assessments (28 findings from 21 studies) (continued) 


Study Findings 


performance score improvements. 


Students with disabilities expressed preference for using one version of an ac- 
commodation over another on the math test. 


Educators indicated that using accommodations benefited students beyond 
math performance score improvements. 


Students/test-takers and Educators 
Students with disabilities and their teachers indicated students’ preference for 1 
using one accommodation package over another on the mathematics tests. 


USES AND PRACTICES ON MATH ASSESSMENTS (==> ae 


A common math assessment accommodation provided to students with dis- 1 
abilities was oral delivery. 


The oral delivery accommodation on math assessments has had variations in 1 
its manner of administration. 

The oral delivery accommodation was implemented differently in math than in 1 
other content areas. 

Common accommodations for students with visual impairments on math as- 1 
sessments included large print, setting based, and extended time. 


This subset of students with visual impairments had unusual accommodations 1 
use patterns. 


MATH ASSESSMENT VALIDITY 
Construct validity was affected by other factors. 


The accommodations did not change the math constructs being tested. 
The accommodations or modifications changed the math construct/s. 


Note: Some of these 21 studies reported support for more than one category of findings. 


Reading. Table 16 presents the 26 findings from 16 studies about accommodations in reading 
assessments, according to participant population then frequency of findings. Reading accom- 
modation findings were wide-ranging, similar to math findings. The most frequent category of 
finding was effects of accommodations on reading assessment performance, with 11 findings 
from 11 studies. Eight enhancements’ effects were reported in these 11 findings, with oral de- 
livery, extended time, and accommodations packages reported in more than one finding each. 
The nine enhancements included seven accommodations: oral delivery (via reading pen and via 
text-to-speech software), extended-time (2 studies), ASL, digital format, accommodation pack- 
ages (3 studies), and various and multiple accommodations (1 study); and two modifications: 
shortening the item stem and adding graphics. Six of the eleven findings pertained to effects for 
students with disabilities, and five pertained to effects for all students. Only two findings were 
supported by more than one study each. The first of these was that accommodations facilitated 
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higher reading performance, found for extended time (Gregg, 2012) and oral delivery (Holmes 
& Silvestri, 2012). The second finding was that accommodations had mixed results for students 
with disabilities, found for comparisons of accommodations categories (Cawthon et al., 2012) 
and for reading pen effects (Schmitt et al., 2012). The remaining seven findings were unique to 
one study each, and not supported by other studies; two of these findings pertained to effects for 
students with disabilities, and five findings pertained to effects for all students. (See Appendix 
F, Table F-12 for details of the individual study findings.) 


The next most frequent type of findings was accommodations patterns of use and practices for 
reading assessments. These seven findings were reported in six different studies. 


Use patterns comprised five findings from four studies. Two studies (Fox, 2012; Kim, 2012) 
supported the general finding that two of the most frequently used accommodations for students 
with visual impairments on reading assessments were large print and extended time. Each study 
diverged from the other in finding additional common accommodations: Fox (2012) indicated 
that other frequent accommodations for this group were small group and individual settings, 
and Kim (2012) included braille as a frequent accommodation for students with visual impair- 
ments in South Korea. Another finding was that one of the most frequently provided reading 
accommodations for students with disabilities in general was oral delivery using human readers 
(Flowers et al., 2011). The fourth finding was from a literature review (Gregg, 2012) that indi- 
cated that youth with learning disabilities, in the context of post-secondary settings, commonly 
received presentation accommodations—primarily oral delivery using text to speech or human 
readers—and timing/scheduling accommodations—primarily extended time, frequent breaks, 
unlimited time, and testing over multiple days. 


The last use pattern finding distinguished between students with visual impairments who had 
more and less functional vision: in general, students using more vision for reading (and math) 
assessment tasks received fewer accommodations, but some students with less vision sometimes 
received fewer or no accommodations than other low-vision peers (Zebehazy et al., 2012). The 
findings on accommodations practices—supported by two studies (Flowers et al., 2011; Holmes 
& Silvestri, 2012)—indicated that oral delivery was administered based on circumstances during 
reading assessments. The contexts diverged in these two studies. Flowers and colleagues (2011) 
found that, during state reading assessments, this accommodation was provided in combination 
with other accommodations due to circumstances—oral delivery during assessment adminis- 
tration required a separate setting and frequent breaks—rather than as a function of students’ 
needs on their individual education program (IEP) plans). Holmes and Silvestri (2012) reported 
that, in postsecondary reading testing, oral delivery was provided through computer software, 
which provided functions such as text to speech and optical character recognition (OCR). The 
reading accommodations reported in the seven use and practices findings were large print and 
extended time (Fox, 2012; Kim, 2012), small group and individual (Fox, 2012), braille and oral 
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delivery—provided by human readers (Kim, 2012), and other visual, tactile, and response-type 
accommodations (Zebehazy et al., 2012) for students with visual impairments; oral delivery 
(Gregg, 2012; Holmes & Silvestri, 2012) for students with learning disabilities; and oral deliv- 
ery provided by human readers and text-to-speech software (Flowers et al., 2011) for students 
with disabilities in general. 


Researchers in five studies reported five findings about perceptions of accommodations used dur- 
ing reading assessments. These findings were categorized by whose perceptions were examined: 
students only—three findings, educators only—one finding, and students and educators—one 
finding. Generally, the findings indicated that accommodations for reading assessments were 
perceived positively. The most common finding, from two studies (Kim, 2012; Flowers et al., 
2011), was that students with disabilities had preferences for accommodations delivered in 
certain ways, over accommodations delivered in other ways. The accommodations reported in 
these five perception findings were oral delivery provided by human reader (Kim, 2012) and 
reading pen (Schmitt et al., 2012), contracted braille (Posey & Henderson, 2012), and comput- 
erized format (Flowers et al., 2011), along with accommodations as assigned on students’ IEPs 
(Feldman et al., 2011). 


Finally, three findings were identified in the 2011-2012 body of research that pertained to po- 
tential effects that accommodations might have on reading constructs being assessed. All three 
findings affirmed that accommodations—text-to-speech software for students with reading dis- 
abilities (Flowers et al., 2011), contracted braille for students with visual impairments (Posey 
& Henderson, 2012), and online test modes for students with learning disabilities (Taherbhai 
et al., 2012)—did not change the reading constructs being tested. (See Appendix F, Table F-12 
for more detailed explanation of findings of each study.) 


Table 16. Summary of Research Findings on Accommodations in Reading Assessments (26 
findings from 16 studies) 
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Table 16. Summary of Research Findings on Accommodations in Reading Assessments 
(continued) 


ie Ae Number of 
Study Findings 


Accommodations package supported improved scores for all students in an 


equal manner. 
Accommodation provided differential benefits in reading performance scores of 1 
students with disabilities compared to those of students without disabilities. 


A unique modification supported differential benefits for a subset of students 1 

with disabilities who were eligible for modified reading assessments. 

Accommodations package supported improved scores for students with dis- 

abilities. 

Accommodation did not support improved scores for students with disabilities 

more than the paper assessment format. 

USES AND PRACTICES ON READING ASSESSMENTS 
i 


Common accommodations for students with visual impairments on reading as- 
sessments included large print and extended time 


The oral delivery accommodation has had variations in its manner of adminis- 
tration during reading assessments. 


A common reading assessment accommodation provided to students with dis- 
abilities was oral delivery. 


2 


Common categories of reading assessment accommodations provided to youth 
with learning disabilities include presentation and timing. 


This subset of students with visual impairments had unusual accommodations 
use patterns 


PERCEPTIONS OF ACCOMMODATIONS IN READING 
Students/test takers only 


Students expressed a preference for one or more accommodations over one or 
more others 

Students indicated that using accommodations benefited them beyond perfor- 
mance score improvements. 


ut 
4 
1 
1 
al 
1 
1 
al 


Student perceptions were mixed about the accommodations studied 
Educators only 1 


Educators recommended improvements in test administration instructions in 1 
order to ensure appropriate supports including accommodations were provided. 


Students/test takers and Educators 
Students with disabilities and their teachers indicated students’ preference for 1 
using one accommodation package over another on the reading tests. 
READING ASSESSMENT VALIDITY aaa 


The accommodations did not change the reading construct/s being tested. 


Note: Some of these 16 studies reported support for more than one category of findings. 


Science. Table 17 details the 9 findings from three studies concerning science assessment accom- 
modations. These findings were categorized into four types, in descending order of frequency: 
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performance effects, perceptions, accommodations uses and practices, and validity. There was 
little agreement either across or within categories in the nature of their findings. For instance, 
of the four findings about accommodations’ effects on performance, two indicated a similar 
conclusion, and one directly conflicted with that conclusion. An enhancement—shortened item 
stems—supported improved science assessment performance for all students, both with and 
without disabilities (Kettler et al., 2012), and an accommodation—oral delivery via recording— 
supported improvement in one part of a science testing module for all students (Shelton, 2012). 
Alternately, two other enhancements—bulleted text and simplified graphics—did not support 
improvements in science assessment scores for all students (Kettler et al., 2012). The fourth effects 
finding was that a set of accommodations, printed text format with a human reader, supported 
greater improvements in science scores larger assessment score results than the score changes 
by the other set, which was a digital format with text-to-speech software (Flowers et al., 2011). 


Researchers in three studies reported three findings about perceptions of accommodations 
used during science assessments. These findings were categorized by whose perceptions were 
examined: students only—two findings, and students and educators—one finding. Generally, 
the findings indicated that accommodations for science assessments were perceived positively. 
A closer review indicated that the findings differed beyond this salient point. One finding was 
that students expressed the general opinion that enhancements benefited them on assessment 
performance (Kettler et al., 2012), and another was that students perceived that a unique oral 
delivery accommodation, in which characters from a virtual environment each “spoke” through 
pre-recorded audio to test takers, was not distracting to assessment completion (Shelton, 2012). 
The third finding was that both teachers and students reported that students showed a preference 
for digital assessment format over printed text format, even though there was no improvement 
in performance (Flowers et al., 2011). 


Another set of findings was accommodations patterns of use and practices during science assess- 
ments; these two findings were reported in one study. One finding pertained to use patterns, and 
one finding was about accommodations practices. Both reported on oral delivery, accompanied 
by print format and digital format science assessments. Flowers and colleagues (2011) reported 
that oral delivery using human readers was one of the most frequently provided accommodations, 
according to state extant data; they contextualized that the frequent use during science assess- 
ments is consistent with many states findings. In the same study, and as was observed about 
oral delivery during math and reading state assessments, the accommodation was administered 
during science assessments by human readers in combination with other accommodations be- 
cause reading aloud required a separate setting and frequent breaks rather than as a function of 
students’ needs on their individual education program (IEP) plans (Flowers et al., 2011). 
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Finally, one validity finding was observed about the impact of accommodations on science 
constructs. Flowers and colleagues (2011) reported that text-to-speech software did not change 
the science constructs being assessed. This was consistent with the same impact noted by these 
researchers for math constructs and reading constructs. (See Appendix F, Table F-13 for more 
detailed explanation of findings of each study.) 


Table 17. Summary of Research Findings on Accommodations in Science Assessments 
(9 findings from 3 studies) 


| Number of 
Study Findings 


SCIENCE PERFORMANCE EFFECTS 


Enhancement supported improved science performance for all—students with 
disabilities as well as students without disabilities. 


Enhancements did not support improved science performance for all—students 
with disabilities as well as students without disabilities. 

Accommodation supported improved science assessment performance of all a 
students. 


Enhancement supported improved science performance for all—students with 
disabilities as well as students without disabilities. 


Students with Disabilities 


Accommodation set supported improved science performance for students with 

disabilities more than another accommodation set. 

PERCEPTIONS OF ACCOMMODATIONS IN SCIENCE es 3a 
Students indicated that using enhancements benefited them in terms of perfor- 

mance score. 


1 


Students/test-takers 
Students indicated that using accommodations benefited them beyond perfor- 


mance score improvements 


Students/test-takers and Educators 


Students with disabilities and their teachers indicated students’ preference for 
using one accommodation package over another on the science tests. 


USES AND PRACTICES ON SCIENCE ASSESSMENTS 


A common accommodation provided to students with disabilities was oral deliv- 1 

ery. 

The oral delivery accommodation has had variations in its manner of adminis- 1 

tration. 

1 


1 
1 
1 
1 
1 
1 
1 
1 


1 


SCIENCE ASSESSMENT VALIDITY 1 


The accommodations did not change the science construct being tested. fe 


Note: Some of these 3 studies reported support for more than one category of findings. 


Writing. Table 18 presents the six findings from four studies about accommodations in writing 
assessments. Writing accommodations findings were categorized into three types: performance 
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effects, uses and practices, and impact on validity. The most frequent findings category was 
effects of accommodations on writing assessment performance, with three findings from two 
studies. Mostly, accommodations were reported to have supported improved performance 
for youth and adults with disabilities, for extended-time (Gregg, 2012) and word-processing 
(Holmes & Silvestri, 2012). Another finding was that word-processing had inconclusive effects 
for adults with learning disabilities completing writing tests, according to a literature review 
(Gregg, 2012). A meta-analysis (Gregg & Nelson, 2012) studying writing performance effects 
for students with and without disabilities yielded that youth with learning disabilities benefited 
more from extended-time than youth without disabilities. 


The other two findings types were writing accommodations uses and practices and writing ac- 
commodations’ effects on assessment validity. Oral delivery had implementation variations in 
the literature review (Holmes & Silvestri, 2012), in that the text-to-speech software examined 
had several supports such as speech- or voice-recognition, as well as other writing supports. The 
researchers also noted that the research literature paid much more attention to other academic 
content and little to writing specifically. The validity finding detailed that the manner of scoring 
writing tests and assessments changed the construct of writing (Koutsoftas & Gray, 2012). (See 
Appendix F, Table F-14 for more detailed explanation of findings of each study.) 


Table 18. Summary of Research Findings on Accommodations in Writing Assessments (6 
findings from 4 studies) 


mee Number of 
Study Findings 


WRITING PERFORMANCE EFFECTS 

Students with Disabilities 
Accommodation supported improved writing performance for students with dis- 
abilities 
Accommodation neither supported nor failed to support improved writing perfor- 
mance scores of students with disabilities 


Accommodation provided differential benefits in writing performance scores of 
students with disabilities compared to those of students without disabilities 


USES AND PRACTICES ON WRITING ASSESSMENTS 
The oral delivery accommodation has had variations in its implementation 
WRITING ASSESSMENT VALIDITY 


The manner of scoring writing tests and assessments changed the writing 
construct/s being tested 


Note: Some of these 4 studies reported support for more than one category of findings. 
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Accommodations in English Language Proficiency Assessments 


Although uncommon in the research about accommodations for students with disabilities, one 
study (Kuti, 2011) examined the performance effects of accommodations on English language 
proficiency (ELP) assessments. The research participants were English language learners who 
had disabilities, and the findings described the use of enhancements—in this case, the changes 
to test directions, presentation formats, timing, and detailed test anxiety-reducing practices. (See 
Appendix F, Table F-15 for more detailed explanation of findings of the study.) 


Limitations and Future Research Directions 


The researchers of most of the studies (n=39) in this body of research literature discussed sev- 
eral limitations (n=85) that provided context for the results they reported. Table 19 presents the 
categories of limitations. We identified all limitations reported in the studies and categorized 
them as fitting in these categories: methodology, sample characteristics, results, test/test con- 
text, and other. We also noted when none were reported by researchers. Of the 39 studies, 30 of 
them identified more than one category of limitation each; the overall average was about two 
limitation categories per study. 


The most commonly reported category of limitations in 2011-2012 studies was sample charac- 
teristics (n=27), which usually referred to the issue that the sample was smaller or narrower than 
intended or required. This issue yielded a challenge to population representativeness, limiting the 
generalizability of the findings beyond the research participants. Almost as frequently reported 
were limitations about results (n=23), when researchers indicated that confounding factors 
constrained the accuracy or consistency of the data, limiting the confidence readers would hold 
about the study’s results. Methodology limitations were also fairly common (n=20); these were 
flaws in research design or practices. Examples of methodology limitations included: students 
were provided multiple accommodations, limiting strong claims about relative gains supported 
by individual accommodations, and randomization of assessment accommodations conditions 
was not possible when using extant data set. Methodology limitations pertained to problems with 
random selection of participants, when sampling from a population, and random assignment of 
participants to study conditions. We observed test and test context limitations less commonly, 
in one-third of the studies (n=13). These types of limitations typically referred to the degree of 
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authenticity of the testing circumstances, especially pertaining to accommodations. Examples 
included when students’ experience with accommodations was uncertain (Posey & Henderson, 
2012), and when the interface between assessments and accommodations was less than ideal 
(Beddow, 2011; Bouck et al., 2011). 


Table 19. Categorized Limitations Identified by Authors 


Limitation Category Number of Studies? 
Sample Characteristics 27 
Results 23 
Methodology 20 
Test/Test Context 13 
No Limitation Listed 8 
Other 3 


@Thirty studies included more than one category of limitations, represented in 2 to 4 limitations categories. 


The researchers of most of the studies (n=44) in this body of research literature discussed several 
future research directions (n=90); these provided indicators of lessons they learned as well as 
their views of the next relevant steps needed to confirm or extend the current studies. Table 20 
presents the categories of limitations; we identified all future research directions reported in the 
studies and categorized them as fitting in these categories: methodology, sample characteristics, 
results, test/test context, and other, and noted when none were reported by researchers. Of the 44 
studies, 32 studies identified more than one future research direction category each; the overall 
average was about two categories per study. 


The most commonly reported category of future research directions in 2011-2012 studies was 
methodology (n=24), where researchers pointed to additional angles that could be taken to 
increase the field’s knowledge and understanding about accommodations—often suggesting 
qualitative methods to uncover meaning beneath findings of the current studies. This category 
was closely followed by research ideas about test or test context (n=21), where researchers 
indicated the need for improvements in assessments in terms of accessibility, and the need for 
deeper understandings of how accommodations might support this goal. Ideas about sample 
characteristics (n=18) as well as results (n=17) to pursue in future research were also fairly com- 
mon. Typical directions about sample characteristics were engaging different types of students 
to affirm or find exceptions to the current studies’ findings. Examples of results-related future 
research directions included discovering the effects of accommodations beyond the academic 
content scope of the current studies (Patterson et al., 2011), and to identify factors that might 
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influence assessment scores (Bouck et al., 2011; Schmitt et al., 2011). Finally, the “other” cat- 
egory numbered 10 studies with various unrelated ideas that were outside of the categories we 
used, such as investigating the effects of professional development activities in changing faculty 
attitudes (Leyser et al., 2011), developing appropriate procedures to systematize identification 
of disabilities (Bolt et al., 2011), and analyzing practical benefits of using computerized testing 
(Patterson et al., 2011). 


Table 20. Categorized Areas of Future Research Directions Identified by Authors 


Future Research Number of Studies? 
Methodology 24 
Test/Test Context 21 
Sample Characteristics 18 
Results 17 
Other 10 
No Future Directions Listed 7 


*Thirty-two studies listed directions for future research that fit into multiple categories. 


Discussion 


Several themes are evident in the research studies published in 2011 and 2012, especially in 
relation to the research studies from 2009 and 2010, which were reported in the previous NCEO 
accommodations research review (Rogers et al., 2012). We address here themes of purposes, 
research designs, assessment types, study participant characteristics, accommodations, academic 
content areas and research findings associated with them, and study limitations and future re- 
search directions. We conclude with several comments on promising trends overall. 


Research Purposes 


Accommodations research literature has continued to change in its focuses. In comparison 
with the research purposes for studies in 2009-2010, the purposes for studies in 2011-2012 
have seemed to change in priorities. In 2009-2010, the purpose of comparing scores between 
participant populations related to the effects of accommodations during assessments comprised 
the largest proportion of studies (at 52%), and the second most frequently-studied purpose was 
examining perceptions and preferences about accommodations (at 40%). In contrast, in 2011- 
2012, the order has shifted to 47% of studies inquiring about perceptions and preferences and 
44% examining accommodations’ effects on assessment performance. Other purposes have 
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become more prominent in researchers’ attention; namely, research summaries have shifted from 
17% of all studies in 2009-2010 to 29% of all studies in 2011-2012, and investigations of test 
validity were 6% of all studies in 2009-2010 and were 14% in 2011-2012. Incidentally, some 
purposes have decreased in their proportion of all studies: discussing issues comprised 38% of 
2009-2010 studies and 29% of 2011-2012 studies, and evaluating test structure comprised 10% 
of 2009-2010 studies and 4% of 2011-2012 studies. However, accommodations use and imple- 
mentation practices were similar in proportion to all studies since they were 21% of 2009-2010 
studies and 24% of 2011-2012 studies. Additionally, addressing multiple purposes in each study 
has continued to be the norm, with nearly 80% of the studies having at least two purposes; in 
fact, in 2011-2012, about 10% of the studies had four purposes, whereas the maximum number 
of purposes in the 2009-2010 studies was three. Similar to 2009-2010, many of the studies in 
2011-2012 combined the purposes of comparing scores related to the effect of accommodations 
on assessments and examining perceptions and preferences about accommodations. 


Research Types and Data Collection Sources 


Half of the research studies in 2011-2012 were quasi-experimental (41%) or experimental (10%). 
Quasi-experimental and experimental designs comprised a smaller proportion of the studies 
in 2011-2012 than in 2009-2010. However, the proportion of descriptive quantitative studies 
was nearly identical (about 20%) across the two time periods. Similarly, the data sources were 
alike—about two-thirds were primary sources and one-third were secondary sources (such as 
extant or archival data) in 2009-2010 and in 2011-2012. Further, the categorical data are about 
evenly split between 2011 and 2012, much like between 2009 and 2010 in the last report. Only 
one exception was noted to this pattern in 2011-2012: for descriptive quantitative studies, four 
used secondary data in 2012 and only one used secondary data in 2011. 


Data Collection Methods 


Comparing 2009-2010 studies’ data with 2011-2012 studies’ data, the collection methods were 
very similar in frequency of use. The most common method was administering tests, used about 
65% of the time in 2009-2010 and almost 60% of the time in 2011-2012. Interviews were put to 
use in about 14% of the studies, and observation in about 6% of the studies, in both 2009-2010 
and 2011-2012. There were only a few, and relatively small, differences in use frequency. The 
second most frequent method was using surveys, employed about 52% of the time in 2009- 
2010 and 43% of the time in 2011-2012. Article review, a method engaged for literature reviews 
and meta-analyses, was used for 6% of the studies in 2009-2010, but for 14% of the studies in 
2011-2012. Analysis of state policies was utilized in 2009-2010 but not in 2011-2012. In both 
sets of research, about 35% of the studies employed more than one method of data collection. 
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Research Participants 


School Level 


Accommodations research has varied in the school level of research participants. We use the 
term “school level” to clarify that we are distinguishing between elementary, middle school, 
and high school. The apparent pattern of increased analysis of multiple school levels within the 
same studies, which was mentioned for the 2009-2010 studies, has sustained at about 25% of 
the studies in 2011-2012. There were only minor differences between the proportions of stud- 
ies when comparing school levels in 2009-2010 and 2011-2012. About 27% of studies in each 
time frame engaged elementary student participants. Nearly 38% of studies in 2009-2010, and 
around 43% of studies in 2011-2012, involved middle school student participants. About 21% 
of studies in each time frame examined data of high school students. Nearly 15% of studies in 
2009-2010, and around 12% of studies in 2011-2012, employed postsecondary participants. 
Finally, the same proportion of studies (about 25%) did not involve students as participants in 
2009-2010 and 2011-2012. 


Disability Categories 


The disability categories of study participants with disabilities differed when comparing 2009- 
2010 studies and 2011-2012 studies. The overall proportion of participants in many disability 
categories decreased. Students with attention-related disabilities (i.e., students identified with 
attention-deficit hyperactivity disorder, or ADHD) participated in 33% of 2009-2010 stud- 
ies and 13% of 2011-2012 studies. Similar decreases occurred for participants with physical 
disabilities, from 27% in 2009-2010 to 10% in 2011-2012 studies, and for participants with 
multiple disabilities, from 24% in 2009-2010 to 7% in 2011-2012. Additional decreases are 
reported here in descending order of difference: for participants with intellectual disabilities, 
from 24% to 10%; for participants with hearing impairments or deafness, from 27% to 17%; and 
for visual impairments or blindness, from 30% to 23%. Among disability groups, only speech/ 
language impairments received about the same amount of attention, in terms of proportion of 
studies with participants (20%), in 2009-2010 and 2011-2012. On the other hand, the propor- 
tion of studies engaging participants without disabilities increased from 33% in 2009-2010 to 
50% in 2011-2012, students with learning disabilities increased from 53% to 57% of relevant 
studies, and students with autism increased from 15% to 17%. We must note that a number of 
studies were excluded from these calculations because they did not include individuals using 
accommodations, whether K-12 students or youth in postsecondary settings, as well as studies 
in which the disability categories were not reported. The relative number of excluded studies 
increased from 15 of 48 in 2009-2010 to 17 of 49 in 2011-2012 (see Table 8 for further details). 
A measure of the decreases in the numbers of studies engaging students in several disabilities 
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categories seems to be related to the decrease in the overall proportion of quasi-experimental 
and experimental studies (comprising nearly 10% fewer), studies that examined the impact of 
accommodations on assessment performance for students with various disabilities. 


Accommodations 


In 2011-2012, research findings highlighted eight specific accommodations, in four of the five 
accommodation categories. In the previous report, spanning 2009-2010, we discussed findings 
about 10 specific accommodations in four categories. In the presentation category, the 2009-2010 
accommodations were oral delivery, braille, and large print; in contrast, 2011-2012 presentation 
accommodations were oral delivery and visual chunking representation (VCR). In 2009-2010, 
equipment/materials accommodations were computer administration, calculator, and American 
sign language (ASL) recording; in 2011-2012, computer administration, basic (four-function) 
calculator, voice-input/speech-output (VISO) calculator, and ASL presented via DVD, comprised 
this category. In 2009-2010, response accommodations were partial scribe, word processing, and 
virtual manipulative; by contrast, only word-processing was specifically examined in 2011-2012. 
Finally, the timing/scheduling category was represented by extended time in both 2009-2010 
and 2011-2012. Additionally, in 2011-2012, modifications were mentioned, including: math 
resource guides, shortening of item stems, bulleted text, and simplified graphics. 


The effects of specific accommodations during various assessments and testing continued to 
receive heightened attention through the analyses of primary data sources. Similar to 2009- 
2010, primary data sources were used in 69% of studies, or 33 out of 48 studies, whereas in 
2011-2012, 65% of studies, or 32 of 49 studies, used primary data sources. 


Academic Content Areas and Associated Research Findings 


Accommodations for mathematics and reading assessments continued to be the most commonly 
examined in 2011-2012 studies, with the number of studies on reading-related accommodations 
increasing (over 2009-2010) to the point where research on math and reading produced similar 
numbers of findings in 2011-2012. Accommodations for science assessments drew attention by 
researchers to similar degrees, with nine identified research findings for 2011-2012 and seven 
in 2009-2010; still, the number of studies differed, with seven studies in 2009-2010 and three in 
2011-2012. Accommodations for writing assessments were investigated by similar numbers of 
studies, with three studies in 2009-2010 and four studies in 2011-2012; the number of findings 
differed, with three findings in 2009-2010 and six findings in 2011-2012. Accommodations for 
social studies assessments were studied twice in 2009-2010, but not at all in 2011-2012. The 
2009-2010 studies that investigated accommodations in multiple content areas numbered 13; 
there were 7 in 2011-2012 studies. It appeared that the outlying year was 2010, in which nine 
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studies investigated accommodations in multiple content areas; the other three years averaged 
about four such studies. 


When examining the findings by specific accommodation, we observed some interesting compari- 
sons and contrasts for the 2011-2012 studies in relation to the 2009-2010 studies. In 2011-2012, 
the performance effects of oral delivery (i.e., human reader, text to speech, pre-recorded audio) 
were more qualified in the sense that the nature of their support for students with disabilities was 
mostly conditioned on student characteristics or testing conditions; in 2009-2010, in contrast, the 
studies reported a more generalized and definitive improvement for students with disabilities. 
A similarity across the two sets of studies is that only one study in each set (Lindstrom, 2010; 
Lazarus et al., 2012) investigated the performance effects for only math; the rest studied effects 
on reading assessments—or both reading and math, in the case of Jordan (2009). 


Findings on the impact of computer administration were reported in studies published in 201 1- 
2012, but with less frequency and with more problematic outcomes than in 2009-2010. Previ- 
ously, three of the four relevant studies found that this accommodation benefited students with 
disabilities—covering the content area of math, or for college coursework in social sciences. In 
2011-2012, on the other hand, the three studies indicated that computer administration did not 
support improved scores for students with disabilities or even for students without disabilities; 
this finding spanned the content areas of math, reading, and other constructs of language arts. 


The calculator accommodation was studied nearly as often in 2011-2012 as it was in 2009- 
2010—that is, there were three studies in 2009-2010 and two studies in 2011-2012. The findings 
showed more positive, although nuanced, support for students with disabilities’ performance, 
in contrast to the 2009-2010 study findings that mostly indicated little benefit for students with 
disabilities. Both 2011-2012 studies examined the impact of calculators on math assessments, 
and no studies examined effects on science assessments. 


The extended-time accommodation’s effect on assessment performance was investigated in 
three studies in 2011-2012, and in five studies in 2009-2010. The slight tendency mentioned in 
2009-2010 studies toward examining the impact of this accommodation for students in post- 
secondary education has continued to a similar degree in 2011-2012, with one study (Gregg 
& Nelson, 2012) presenting a meta-analysis of extended time and its impact for transitioning 
adolescents with learning disabilities. The findings about the extended-time accommodation in 
2009-2010 studies ranged across several content areas; this finding of various content areas has 
continued in 2011-2012, with academic areas included reading only (Brown et al., 2011) and 
math, reading and writing (Gregg & Nelson, 2012), and unspecified academic content areas in 
the third study, a literature review (Lovett, 2011). 
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Perceptions 


In another set of studies from 2011 through 2012, researchers described perceptions about 
accommodations, as expressed by test-takers and educators, through surveys, focus groups, 
or interviews. In this timeframe, the studies produced 24 findings, in comparison with 14 in 
2009-2010. Students’ perceptions were reported in 13 findings in 2011-2012, and 9 in 2009- 
2010. Educators’ perceptions were reported in 11 findings in 2011-2012, and 4 in 2009-2010. 
Through closer examination of student perception findings, we identified in 2011-2012 many 
more findings indicating that students were more positive about various accommodations, both 
in relation to assessment performance (n=4) and about additional benefits (n=4); in contrast, 
we noted in 2009-2010 that students expressed “mixed” perceptions about accommodations 
(n=2). In addition, student perception findings decreased from five findings about preferences 
of one version of specific accommodations over another in 2009-2010 to only two studies of 
this type in 2011-2012. 


Educator perceptions about accommodations seem to have shifted from being described as 
“mixed” (n=3) or positive (n=1) in 2009-2010; instead, in 2011-2012, educator perceptions 
were reported to be either varying degrees of positive (n=3) or generally positive (n=3). Also, 
descriptions of educators’ reflections findings increased to four studies in 2011-2012. These 
studies addressed educators’ reflections on their own knowledge of, and familiarity with, various 
accommodations. Finally, one study in 2009-2010 (Jordan, 2009) noted that different participant 
groups—students, teachers, and parents—had various and different views of accommodations; 
in contrast, a similar study in 2011-2012 (Flowers et al., 2011) reported on similar views of 
accommodations from both students and educators. When analyzing perceptions findings by 
academic content area, there have been several changes. In 2009-2010, about 25% of studies 
about mathematics included accommodations perceptions; the 2011-2012 proportion for math 
was 29%. In reading, the 2009-2010 perceptions studies accounted for approximately 17% of 
that content area; the corresponding 2011-2012 proportion was about 31% of studies, and about 
20% of all findings. All three 2011-2012 science studies had at least a component about accom- 
modations perceptions, whereas in 2009-2010, only one of seven studies reported these types of 
findings. Finally, perceptions of writing-related accommodations have remained uninvestigated 
from 2009 through 2012. 


Validity 


The increased emphasis on the impact of accommodations on construct validity in the 2009-2010 
literature changed in 2011-2012—from 21 findings then to 8 findings. The relevant statistic in 
2007-2008 was also eight findings. A contrast was found in the nature of the research findings, 
in that 2009-2010 studies predominantly indicated that accommodations did not influence 
academic construct measurement in nearly all of the findings pertaining to validity. Construct 
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validity findings in 2011-2012 studies were more complicated than in 2009-2010: three find- 
ings indicated no impact on reading, science, and math constructs; two findings indicated that 
math construct validity (Randall, Cheong, & Engelhard, 2011) was affected, as were the validi- 
ties of various academic constructs (Lovett, 2011). Finally, three findings indicated that other 
factors mediated the relationship between accommodations and the academic constructs being 
measured on the assessments. 


Limitations 


The most noticeable difference between the accommodations research of 2009 through 2010 and 
the research of 2011 through 2012 in terms of researchers’ identification of limitations of their 
studies is the change in the rank-ordering of the five categories of limitations. The 2011-2012 
studies listed in order of frequency were: sample characteristics, results, methodology, test/test 
context, and other; in contrast, the 2009-2010 studies listed in order of frequency were: meth- 
odology, sample characteristics, results, test/test context, and other. Within this observation, the 
largest difference was that results-type limitations numbered 23 in 2011-2012, compared to only 
12 in 2009-2010. There were only 20 methodology-related limitations in 2011-2012, compared 
to 29 in 2009-2010. Other comparisons of limitations between the timeframes yielded modest 
differences. In 2011-2012, researchers identified no limitations in 16% of the studies, and we 
classified limitations as “other” in 6% of the studies. In 2009-2010, researchers identified no 
limitations in about 21% of the studies, and we classified limitations as “other” in about 13% of 
the studies. Additionally, researchers noted more types of limitations and future research direc- 
tions in each study in 2011-2012. In the 2011-2012 studies, 61% of the studies reported more 
than one limitation category, whereas multiple limitation categories in 2009-2010 were identi- 
fied in 54% of the studies. Further, the 2009-2010 studies averaged about 2 types of limitations 
per study, but the 2011-2012 studies averaged 2.1 types of limitations per study. It is difficult 
to discern whether this difference is a trend, yet it seems that more study researchers reported 
limitations, and more types of limitations were being reported in those studies that noted them, 
than in the previous time span studied. 


Future Research Directions 


When comparing the reporting of future research directions in the 2011-2012 studies and the 
2009-2010 studies, there was a change in the rank-ordering of the five categories used to classify 
them, and also a change in prevalence of studies in the categories. Test and/or test context-related 
directions were identified in 21 studies in 2011-2012, compared to 15 studies in 2009-2010, 
and sample characteristics denoted research ideas in 18 studies in 2011-2012, compared to 15 
studies in 2009-2010. Also, we observed results-oriented future research directions in 17 stud- 
ies in 2011-2012, compared to 5 studies in 2009-2010. In 2011-2012, researchers identified no 
future research directions in 14% of the studies, and we classified limitations as “other” in 20% 
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of the studies. In 2009-2010, researchers identified no limitations in about 19% of the studies, 
and we classified future research directions as “other” in about 13% of the studies. Additionally, 
researchers noted more limitations and future research directions in each study in 2011-2012. 
In the current studies, 65% of the studies reported more than one future research direction, 
whereas multiple future directions in 2009-2010 were identified in 42% of the studies. Further, 
the 2009-2010 studies averaged about 1.7 future research direction categories per study, but 
the 2011-2012 studies averaged 2.1 categories per study. It seems possible that this difference 
could be a trend because the differences were broader than for the limitations. 
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Appendix A 


Research Purposes 


Table A-1. Purpose Category: Study or Compare Perceptions of Accommodation Use (n=23) 


Author/s 


Stated Research Purpose 


Also 


Beddow (2011) 


Identify test-takers’ perceptions about their testing experiences; also, 
discern effects of using accommodations and modifications for students 
who were eligible for participating in state alternate assessments based 
on modified achievement standards (AA-MASs), when administered 
mathematics items under grade-level and alternate standards conditions; 
finally, summarize research findings on the effects of accommodations 
and/or modifications provided during states’ AA-MASs. 


A-2, 


Bolt et al. 
(2011) 


Inquire from postsecondary students with reading and writing disabilities 
about their experiences of 14 accommodations including 5 forms of read- 
aloud (including human reader and via various media), dictionary, large- 
print, extended-time, more frequent breaks, individual setting, small-group 
setting, dictated response (to scribe or to recording), and word-processor 
with spell-check; also, uncover from accommodations users about what 
hindered and facilitated their accommodation use. 


Bouck et al. 
(2011) 


Investigate the impact of a computer-based voice-input, speech output 
calculator on test-taking behaviors of students with visual impairments, 
and the perspectives of these students regarding using the accommoda- 
tion. 


N/A 


Brockelmann 
(2011) 


Uncover academic strategies including assessment accommodations that 
higher education faculty use with students who have psychiatric disabili- 
ties, and discern strategy differences of degree and kind between faculty 
teaching science, technology, engineering, and mathematics (STEM) 
courses, and faculty who teach courses in other academic disciplines. 


N/A 


Feldman et al. 
(2011) 


Investigate the possible influence of the factors of test-related anxiety, 
test-related self-efficacy, motivation to work hard on tests, and positive 
regard for large-scale achievement tests in general, also, examine the dif- 
ferent scoring patterns that students with disabilities and students without 
disabilities have during reading and language arts achievement assess- 
ments. 


Flowers et al. 
(2011) 


Explore the perspectives of students and educators about the testing 
experience; discover possible performance variation in an extant data 

set of students with disabilities using read-aloud on paper-and-pencil and 
computerized formats; also, clarify whether item difficulty was associated 
with item format; finally, discern construct validity related to the formats of 
the assessment. 


A-2, 
A-6, 
A-7 
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Author/s 


Stated Research Purpose 


Also 


Hodgson et al. 


(2012) 


Describe perspectives of special educators regarding read-aloud, in- 
cluding the differing use and implementation with reading versus math 
assessments, including that math requires more administrator preparation 
and content knowledge; also, discuss issues regarding additional ben- 
efits, beyond access, such as increased endurance and motivation and 
decreased concentration under some circumstances. 


A-4 


lhori (2012) 


Investigate postsecondary faculty perceptions of various accommoda- 
tions as provided in 2-year and 4-year programs; contextualize this 
study’s findings with the current research literature; also, discuss issues 
of youth with attention-deficit hyperactivity disorder (ADHD); finally, report 
on accommodation knowledge and practices of postsecondary faculty 
members. 


A-3, 
A-4, 
A-5 


Kettler et al. 
(2012) 


Report on students’ perceptions of assessment enhancements; compare 
extant state mathematics assessment data of students with various dis- 
abilities and students without disabilities when using presentation accom- 
modations and calculators; also, compare the effects of modifications 
and accommodations on alternate science (biology) assessment items 
for students with disabilities who were eligible or not eligible for modified 
assessment, along with students without disabilities; finally, determine 
construct validity of the items when using enhancements. 


A-2, 
A-6, 
A-7 


Kim (2012) 


Report about test-takers’ experiences while completing assessment 
items; also, compare the effects of read-aloud, when offered and not of- 
fered, along with large print, braille, and extended time, for students with 
and without visual impairments; finally, report on accommodations use for 
students with visual impairments on Korean reading assessment items in 
South Korea. 


Lazarus et al. 
(2012) 


Inquire about the perspectives of test takers on their testing accommoda- 
tion experiences; also, compare the impact of read-aloud on statewide 
math assessment item scores for students already identified to receive 
that accommodation. 


Leyser et al. 
(2011) 


Investigate perceptions of postsecondary faculty about accommodations 
at two points across a ten-year time span. 


N/A 


Lipscomb 
(2012) 


Detail demographic differences in perceptions, including regarding ac- 
commodations’ effectiveness; also, Summarize research literature and 
this study’s findings in context; finally, report on the experience of general 
educators and special educators about accommodations typically pro- 
vided to students with specific learning disabilities. 


A-3, 
A-4 


Makeham & 
Lee (2012) 


Discuss results of test-takers’ perceptions of the trial use of oral delivery 
via iPod. 


N/A 
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Authorls Stated Research Purpose Also 
Describe the attitudes and practices of general educators and special 
Meadows educators about assessment and instructional accommodations; also, A-3 
(2012) summarize the research literature on the topic, and report about the cur- 
rent study’s findings in context. 
Report on participants’ examination experiences; also, investigate the 
Patterson et al. | effects of computerized format on General Equivalency Diploma (GED) M2 
(2011) examination scores of youths and adults with and without disabilities and 
report on participants’ examination experiences. 
Seek information from higher education faculty regarding their perspec- 
tives about providing online course accommodations, including for 
aa examinations; also, discuss issues related to higher education institutions 
Phillips et al. oe : ce d A-4, 
providing access to online coursework opportunities for students with 
(2012) ar aaa , ; : A-5 
disabilities; finally, discover the current accommodations implementation 
activities, including detecting variation of resources and skill based on 
faculty members’ fields and professional experiences. 
Report on users’ perceptions of reading pen benefits, including enjoyment 
Schmitt et al. and satisfaction; also, compare comprehension effects of using read- A-2 
(2012) ing pen as a decoder with using it with additional vocabulary support, for 
postsecondary students with varying degrees of reading disabilities. 
Report on users’ perceptions of reading pen benefits, including helpful- 
Sanit Seal. ness and enjoyment; also, compare comprehension effects including 
(2011) speed and accuracy of using reading pen as a decoder with using it with A-2 
additional vocabulary support, for high school students with specific learn- 
ing disabilities. 
Report about students’ perceptions of read-aloud and attitudes about 
content during assessment; compare effects of read-aloud on scores on A-2, 
Shelton (2012) | science assessment from students with and without learning disabilities; A-3, 
also, summarize research findings and this study’s findings in context; A-6 
finally, analyze item-level effects. 
Report on students’ perceptions of accommodation benefits; also, com- 
Zhang et al. 
(2012) pare memory effects of using visual chunking representation accommo- A-2 
dation on geometry test items for students with math disabilities. 
Report about the self-perceived knowledge of special educators of 
students with visual impairments throughout the U.S. about assistive 
Zhou et al. ; ; 
technology; also, discuss the issues about professional development pro- | A-4 
(2012) A oer : 
grams regarding supporting assistive technology needs of students with 
visual impairments. 
Report about the self-perceived knowledge of Texas special educators of 
Zhou et al. students with visual impairments about assistive technology; also, discuss 
: ; A-4 
(2011) the issues about professional development programs regarding support- 
ing assistive technology needs of students with visual impairments. 
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Table A-2. Purpose Category: Compare Scores from Standard/Nonstandard Administration 
Conditions (n=21) 


Author/s 


Stated Research Purpose 


Also 


Only students with disabilities 


Cawthon et al. 
(2011) 


Compare the impact on reading and math scores between the use of ASL 
instructions with standard written administration and ASL instructions and 
items interpreted for students with deafness or hearing impairments. 


N/A 


Cawthon et al. 
(2012) 


Investigate the differing impact of various types of accommodations on 
scores on National Assessment of Educational Progress (NAEP) math- 
ematics and reading items for students with learning disabilities; also, 
analyze linguistic complexity’s effects on item difficulty for students with 
learning disabilities. 


A-6 


Flowers et al. 
(2011) 


Explore the perspectives of students and educators about the testing 
experience; discover possible performance variation in an extant data 

set of students with disabilities using read-aloud on paper-and-pencil and 
computerized formats; also, clarify whether item difficulty was associated 
with item format; finally, discern construct validity related to the formats of 
the assessment. 


A-1, 
A-6, 
A-7 


Fox (2012) 


Investigate the differing effects, on state mathematics and reading as- 
sessment scores, of accommodations as provided to different grade lev- 
els, and cohorts across three years, of the state’s population of students 
with each disability category—such as students with visual impairments, 
students with hearing impairments, and students with learning disabilities; 
also, contextualize these performance results in light of similar studies of 
accommodations effects for similar students with disabilities; finally, report 
on accommodations use for and by these students. 


A-4, 
A-5 


Kuti (2011) 


Investigate the effects of various accommodations on English language 
proficiency (ELP) assessment scores for English language learners with 
disabilities; also, summarize research findings on benefits and limitations 
of assessment supports across disability groups and language groups; re- 
port on the current availability of ELP tests for ELLs with disabilities, and 
accessibility issues related to addressing students’ unique needs, from 
educators’ perspectives; finally, analyze data from students with various 
disabilities who received various accommodations for patterns. 


Lazarus et al. 
(2012) 


Inquire about the perspectives of test takers on their testing accommoda- 
tion experiences; also, compare the impact of read-aloud on statewide 
math assessment item scores for students already identified to receive 
that accommodation. 


Schmitt et al. 
(2012) 


Report on users’ perceptions of reading pen benefits, including enjoyment 
and satisfaction; also, compare comprehension effects of using read- 

ing pen as a decoder with using it with additional vocabulary support, for 
postsecondary students with varying degrees of reading disabilities. 
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Authorls Stated Research Purpose Also 
Report on users’ perceptions of reading pen benefits, including helpful- 
SAhmithet al ness and enjoyment; also, compare comprehension effects including 
(2011) , speed and accuracy of using reading pen as a decoder with using it with A-1 
additional vocabulary support, for high school students with specific learn- 
ing disabilities. 
Examine extant reading and mathematics alternate assessment data from 
Zebehazy et students with visual impairments (VI) to compare the varying score results 
al. (2012) for students with more and less functional vision; also, analyze the score A-9 
; patterns of students with VI to discern the need for the accommodations 
that they received. 
Zhang et al Report on students’ perceptions of accommodation benefits; also, com- 
(2012) : pare memory effects of using visual chunking representation accommoda-| A-1 
tion on geometry test items for students with math disabilities. 
Both students with disabilities and students without disabilities 
Compare receptive and expressive language scores on vocabulary as- 
Alt & Moreno sessments when using paper-based and computer-administered tests, 
(2012) for students with autism spectrum disorders (ASDs) and students with no A-6 
neurological disabilities; also, detect any differences in behavioral difficul- 
ties between administration formats during the test-taking experience. 
Identify test-takers’ perceptions about their testing experiences; also, 
discern effects of using accommodations and modifications for students 
who were eligible for participating in state alternate assessments based M1 
Beddow (2011) | on modified achievement standards (AA-MASs), when administered , 
eres a A-3 
mathematics items under grade-level and alternate standards conditions; 
finally, summarize research findings on the effects of accommodations 
and/or modifications provided during states’ AA-MASs. 
Engelhard et Investigate the individual impacts of calculators and resource guides on 
al. (2011) state mathematics assessment performance extant data from both stu- N/A 
, dents with disabilities and students without disabilities. 
Investigate the possible influence of the factors of test-related anxiety, 
test-related self-efficacy, motivation to work hard on tests, and positive 
Feldman etal. | regard for large-scale achievement tests in general; also, examine the dif- M1 
(2011) ferent scoring patterns that students with disabilities and students without 
disabilities have during reading and language arts achievement assess- 
ments. 
ahicrebal Compare the effects of modifications on alternate assessment items for 
(2011) , students with disabilities who were eligible or not eligible for modified as- N/A 
sessment, along with students without disabilities. 
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Author/s 


Stated Research Purpose 


Also 


Kettler et al. 
(2012) 


Report on students’ perceptions of assessment enhancements; compare 
extant state mathematics assessment data of students with various dis- 
abilities and students without disabilities when using presentation accom- 
modations and calculators; also, compare the effects of modifications 
and accommodations on alternate science (biology) assessment items 
for students with disabilities who were eligible or not eligible for modified 
assessment, along with students without disabilities; finally, determine 
construct validity of the items when using enhancements. 


A-1, 
A-6, 
A-7 


Kim (2012) 


Report about test-takers’ experiences while completing assessment 
items; also, compare the effects of read-aloud, when offered and not of- 
fered, along with large print, braille, and extended-time, for students with 
and without visual impairments; finally, report on accommodations use for 
students with visual impairments on Korean reading assessment items in 
South Korea. 


A-1, 
A-5 


Koutsoftas & 
Gray (2012) 


Compare narrative and expository writing evaluation results of students 
with language learning disabilities and students without disabilities; also, 
uncover patterns in assessment results when applying analytic and holis- 
tic scoring approaches. 


A-7 


Patterson et al. 
(2011) 


Report on participants’ computerized examination experiences; also, 
investigate the effects of computerized format on General Equivalency 
Diploma (GED) examination scores of youths and adults with and without 
disabilities. 


Shelton (2012) 


Report about students’ perceptions of read-aloud and attitudes about 
content during assessment; compare effects of read-aloud on scores on 
science assessment from students with and without learning disabilities; 
also, summarize research findings and this study’s findings in context; 
finally, analyze item-level effects. 


A-6 


Srivastava & 
Gray (2012) 


Compare scores of students with learning disabilities and without learn- 
ing disabilities on reading assessments using nonlinear paper-based 

text passages and nonlinear computerized text passages. Nonlinear text 
passages permitted test-takers to determine the order of text reading, and 
included vocabulary support. 


N/A 
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Table A-3. Purpose Category: Summarize Research Literature about Accommodations (n=14) 


Author/s 


Stated Research Purpose 


Also 


Beddow 
(2011) 


Identify test-takers’ perceptions about their enhanced testing experiences; 
also, discern effects of using accommodations and modifications for stu- 
dents who were eligible for participating in state alternate assessments 
based on modified achievement Standards (AA-MASs), when administered 
mathematics items under grade-level and alternate standards conditions; 
finally, summarize research findings on the effects of accommodations and/ 
or modifications provided during states’ AA-MASs. 


A-1, 
A-2 


Davis (2011) 


Summarize research findings on the effects and limitations of accommo- 
dations; also, review various accommodations practices issues, including 
implementation barriers; finally, inquire from secondary general educators 
about specific knowledge and practices related to many types of accommo- 
dations, such as read-aloud in various formats, scribe, breaks, and individu- 
al administration. 


A-4, 
A-5 


Fox (2012) 


Investigate the differing effects, on state mathematics and reading assess- 
ment scores, of accommodations as provided to different grade levels, and 
cohorts across three years, of the state’s population of students with each 
disability category—such as students with visual impairments, students with 
hearing impairments, and students with learning disabilities; also, contextu- 
alize these performance results in light of similar studies of accommodations 
effects for similar students with disabilities; finally, report on accommoda- 
tions use for and by these students. 


A-2, 
A-5 


Gregg 
(2012) 


Summarize research findings of 32 studies (not all empirical) on the effects 
of accommodations, most notably extended time; discuss accommodations 
issues of students with learning disabilities in late adolescence and young 
adulthood, including when completing college entrance examinations. 


Meta-analyze research findings of 9 studies on the effects of the extended- 


A-3, 
A-4 


Gregg & time accommodation on assessment results of youth with learning dis- 
Nelson abilities, including when completing college entrance examinations; also, A-4 
(2012) discuss assessment accommodations issues of youths with learning disabili- 
ties, identified using various disability definitions. 
Summarize findings of about 20 studies regarding assistive technology's 
Holmes & effects for students with learning disabilities (LD) in postsecondary settings; A-A 
Silvestri also, discuss issues regarding avenues of availability of assistive technology A-5 
(2012) (AT) for postsecondary students with disabilities; finally, describe AT prac- 
tices and use for postsecondary students with disabilities. 
Investigate postsecondary faculty perceptions of various accommodations 
as provided in 2-year and 4-year programs; also, contextualize this study’s A-1, 
Ihori (2012) | findings with the current research literature; discuss issues of youth with A-4, 
attention-deficit hyperactivity disorder (ADHD); finally, report on accommo- A-5 
dation knowledge and practices of postsecondary faculty members. 
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Authorls Stated Research Purpose Also 
Investigate the effects of various accommodations on English language 
proficiency (ELP) assessment scores for English language learners with 
disabilities; also, summarize research findings on benefits and limitations of A-2 

Kuti (2011) assessment supports across disability groups and language groups; report A-4. 
on the current availability of ELP tests for ELLs with disabilities, and acces- 

Tac ; setae : A-5 
sibility issues related to addressing students’ unique needs, from educators 
perspectives; finally, analyze data from students with various disabilities who 
received various accommodations for patterns. 

Detail demographic differences in perceptions, including regarding ac- 
: commodations’ effectiveness; also, summarize research literature and 

Lipscomb . Wo ; ~e ; A-1, 
this study’s findings in context; finally, report on the experience of general 

(2012) A-4 
educators and special educators about accommodations typically provided 
to students with specific learning disabilities. 

Describe the attitudes and practices of general educators and special edu- 

Meadows cators about assessment and instructional accommodations; also, summa- M1 

(2012) rize the research literature on the topic, and report about the current study’s 
findings in context. 

Present a longitudinal perspective on developments in accommodations for 
students with hearing impairments; also, describe issues pertaining to the 

Qi & Mitchell | provision of accommodations to students with deafness and hearing impair- | A-4, 

(2012) ments, such as American sign language and modified English; finally, detail A-5 
accommodations practice and use, especially pertaining to the Stanford 
Achievement Test for deaf students. 

Report about students’ perceptions of read-aloud and attitudes about con- 
tent during assessment; compare effects of read-aloud on scores on science | A-1, 

Shelton ; ; we ea, 

(2012) assessment from students with and without learning disabilities; also, sum- A-2, 
marize research findings and this study’s findings in context; finally, analyze A-6 
item-level effects. 

Present evidence for types of cognitive challenges that a segment of higher 
: education students with disabilities and others has when taking tests, and 
Shinn & we 
d demonstrate that research literature has identified effective accommoda- 

Ofiesh ie ae ; ae ree A-4 
tions for students with cognitive difficulties, even beyond identified disability 

(2012) inten te me 
populations; discuss issues related to higher education providing wider ac- 
cess for underserved populations. 

Smith & Present a list of accommodations based on literature on best practices for 

Amato students with visual impairments; also, report on state-by-state use of ac- A-5 

(2012) commodations policies and practices. 
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Table A-4. Purpose Category: Discuss Issues Related to Accommodations (n=14) 


Author/s 


Stated Research Purpose 


Also 


Davis 
(2011) 


Summarize research findings on the effects and limitations of accommo- 
dations; also, review various accommodations practices issues, including 
implementation barriers; finally, inquire from secondary general educators 
about specific knowledge and practices related to many types of accommo- 
dations, such as read-aloud in various formats, scribe, breaks, and individual 
administration. 


A-3, 
A-5 


Gregg 
(2012) 


Summarize research findings of 32 studies (not all empirical) on the effects 
of accommodations, most notably extended-time; also, discuss accommo- 
dations issues of students with learning disabilities in late adolescence and 
young adulthood, including when completing college entrance examinations. 


A-3 


Gregg & 
Nelson 
(2012) 


Meta-analyze research findings of 9 studies on the effects of the extended- 
time accommodation on assessment results of youth with learning disabili- 
ties, including when completing college entrance examinations; also, discuss 
assessment accommodations issues of youths with learning disabilities, 
identified using various disability definitions. 


Hodgson et 
al. (2012) 


Describe perspectives of special educators regarding read-aloud, including 
the differing use and implementation with reading versus math assessments, 
including that math requires more administrator preparation and content 
knowledge; also, discuss issues regarding additional benefits, beyond ac- 
cess, such as increased endurance and motivation and decreased concen- 
tration under some circumstances. 


A-1 


Holmes & 
Silvestri 
(2012) 


Summarize findings of about 20 studies regarding assistive technology's 
effects for students with learning disabilities (LD) in postsecondary settings; 
also, discuss issues regarding avenues of availability of assistive technology 
(AT) for postsecondary students with disabilities; finally, describe AT prac- 
tices and use for postsecondary students with disabilities. 


A-3, 
A-5 


lhori (2012) 


Investigate postsecondary faculty perceptions of various accommodations 
as provided in 2-year and 4-year programs; also, contextualize this study’s 
findings with the current research literature; discuss issues of youth with 
attention-deficit hyperactivity disorder (ADHD); finally, report on accommoda- 
tion knowledge and practices of postsecondary faculty members. 


A-1, 
A-3, 
A-5 


Kuti (2011) 


Investigate the effects of various accommodations on English language 
proficiency (ELP) assessment scores for English language learners with 
disabilities; also, summarize research findings on benefits and limitations of 
assessment supports across disability groups and language groups; report 
on the current availability of ELP tests for ELLs with disabilities, and acces- 
sibility issues related to addressing students’ unique needs, from educators’ 
perspectives; finally, analyze data from students with various disabilities who 
received various accommodations for patterns. 


A-2, 
A-3, 
A-5 


NCEO 
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Authorls Stated Research Purpose Also 
Detail demographic differences in perceptions, including regarding ac- 
: commodations’ effectiveness; also, summarize research literature and this 
Lipscomb Se sn : oe . A-1, 
study’s findings in context; finally, report on the experience of general edu- 
(2012) : : ; A-3 
cators and special educators about accommodations typically provided to 
students with specific learning disabilities. 
Discuss issues including limitations of using the extended-time accommo- 
Lovett ce : : : d : : 
dation; also, describe practical considerations for using extended-time for A-5 
(2011) ca ha ae 
students with disabilities. 
Seek information from higher education faculty regarding their perspectives 
about providing online course accommodations, including for examinations; 
ae also, discuss issues related to higher education institutions providing ac- 
Phillips et : a : : lc gs A-1, 
cess to online coursework opportunities for students with disabilities; finally, 
al. (2012) ; : . : bons ro : A-5 
discover the current accommodations implementation activities, including 
detecting variation of resources and skill based on faculty members’ fields 
and professional experiences. 
Present evidence for types of cognitive challenges that a segment of higher 
: education students with disabilities and others has when taking tests, and 
Shinn & ‘ ; i ; 
: demonstrate that research literature has identified effective accommoda- 
Ofiesh ; 2 eee ie neater A-3 
tions for students with cognitive difficulties, even beyond identified disability 
(2012) aes ; ; ; is ; 
populations; also, discuss issues related to higher education providing wider 
access for underserved populations. 
Present a longitudinal perspective on developments in accommodations for 
students with hearing impairments; also, describe issues pertaining to the 
Qi & Mitch- | provision of accommodations to students with deafness and hearing impair- A-3, 
ell (2012) ments, such as American sign language and modified English; finally, detail A-5 
accommodations practice and use, especially pertaining to the Stanford 
Achievement Test for deaf students. 
Report about the self-perceived knowledge of special educators of students 
Zhou etal. | with visual impairments throughout the U.S. about assistive technology; also, 
; : : A-1 
(2012) discuss the nature of professional development programs regarding support- 
ing assistive technology needs of students with visual impairments. 
Report about the self-perceived knowledge of Texas special educators of 
Zhou et al. | students with visual impairments about assistive technology; also, discuss 
; ‘ d A-1 
(2011) the issues about professional development programs regarding supporting 
assistive technology needs of students with visual impairments. 
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Table A-5. Purpose Category: Report on Implementation Practices and Accommodations Use 


(n=11) 


Author/s 


Stated Research Purpose 


Also 


Bolt et al. 
(2011) 


Inquire from postsecondary students with reading and writing disabilities 
about their experiences of 14 accommodations including 5 forms of read- 
aloud (including human reader and provision via various forms of technol- 
ogy), dictionary, large-print, extended-time, more frequent breaks, individual 
setting, small-group setting, dictated response (to scribe or to recording), 
and word-processor with spell-check; also, uncover from accommodations 
users about what hindered and facilitated their accommodation use. 


Cawthon 
(2011) 


Examine decision-making processes for educators of students with hearing 
impairments regarding selection of possible accommodations including ex- 

tended time, test directions interpreted, test items interpreted, student signs 
response to a scribe, and others. 


N/A 


Davis 
(2011) 


Summarize research findings on the effects and limitations of accommo- 
dations; also, review various accommodations practices issues, including 
implementation barriers; finally, inquire from secondary general educators 
about specific knowledge and practices related to many types of accommo- 
dations, such as read-aloud in various formats, scribe, breaks, and individual 
administration. 


A-3, 
A-4 


Fox (2012) 


Investigate the differing effects, on state mathematics and reading assess- 
ment scores, of accommodations as provided to different grade levels, and 
cohorts across three years, of the state’s population of students with each 
disability category—such as students with visual impairments, students with 
hearing impairments, and students with learning disabilities; also, contextual- 
ize these performance results in light of similar studies of accommodations 
effects for similar students with disabilities; finally, report on accommodations 
use for and by these students. 


A-2, 
A-3 


Holmes & 
Silvestri 
(2012) 


Summarize findings of about 20 studies regarding assistive technology's 
effects for students with learning disabilities (LD) in postsecondary settings; 
also, discuss issues regarding avenues of availability of assistive technology 
(AT) for postsecondary students with disabilities; finally, describe AT prac- 
tices and use for postsecondary students with disabilities. 


A-3, 
A-4 


lhori (2012) 


Investigate postsecondary faculty perceptions of various accommodations 
as provided in 2-year and 4-year programs; contextualize this study’s find- 
ings with the current research literature; also, discuss issues of youth with 
attention-deficit hyperactivity disorder (ADHD); finally, report on accommoda- 
tion knowledge and practices of postsecondary faculty members. 


A-1, 
A-3, 
A-4 


Kim (2012) 


Report about test-takers’ experiences while completing assessment items; 
also, compare the effects of read-aloud, when offered and not offered, along 
with large print, braille, and extended-time, for students with and without 
visual impairments; finally, report on accommodations use for students with 
visual impairments on Korean reading assessment items in South Korea. 


A-1, 
A-2 


NCEO 
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Authorls Stated Research Purpose Also 
Investigate the effects of various accommodations on English language 
proficiency (ELP) assessment scores for English language learners with 
disabilities; also, summarize research findings on benefits and limitations of A-2 
Kuti (2011) assessment supports across disability groups and language groups; report A-3. 
on the current availability of ELP tests for ELLs with disabilities, and acces- 
SG, oe ; A-4 
sibility issues related to addressing students’ unique needs, from educators 
perspectives; finally, analyze data from students with various disabilities who 
received various accommodations for patterns. 
oucit Discuss issues including limitations of using the extended-time accommo- 
dation; also, describe practical considerations for using extended time for A-4 
(2011) ei ai as 
students with disabilities. 
Seek information from higher education faculty regarding their perspectives 
about providing online course accommodations, including for examinations; 
ae also, discuss issues related to higher education institutions providing ac- 
Phillips et ; ie ; ‘ ataeea A-1, 
cess to online coursework opportunities for students with disabilities; finally, 
al. (2012) : renee A-4 
discover the current accommodations implementation activities, including 
detecting variation of resources and skill based on faculty members’ fields 
and professional experiences. 
Present a longitudinal perspective on developments in accommodations for 
students with hearing impairments; also, describe issues pertaining to the 
Qi & Mitch- | provision of accommodations to students with deafness and hearing impair- A-3, 
ell (2012) ments, such as American sign language and modified English; finally, detail A-4 
accommodations practice and use, especially pertaining to the Stanford 
Achievement Test for deaf students. 
Smith & Present a list of accommodations based on literature on best practices for 
Amato students with visual impairments; also, report on a state-by-state view of ac- A-3 
(2012) commodations policies and practices. 
Table A-6. Purpose Category: Compare Test ltems across Assessment Formats (n=11) 
Authorls Stated Research Purpose Also 
Investigate the role that certain features of reading test items (cognitive, 
grammatical, lexical, textual/visual) play in leading to these functional 
Abedi et al. iff a oa h ith disabili 
(2011) di erences; also, examine t e scoring patterns t at students with disabili- A-7 
ties and students without disabilities have during reading assessments to 
determine construct validity. 
Compare receptive and expressive language scores on vocabulary as- 
aie Moreno sessments when using paper-based and computer-administered tests, 
(2012) for students with autism spectrum disorders (ASDs) and students with no A-2 
neurological disabilities; also, detect any differences in behavioral difficul- 
ties between administration formats during the test-taking experience. 
72 NCEO 


Author/s 


Stated Research Purpose 


Also 


Cawthon et 
al. (2012) 


Investigate the differing impact of various types of accommodations on 
scores on National Assessment of Educational Progress (NAEP) math- 
ematics and reading items for students with learning disabilities; also, 
analyze linguistic complexity’s effects on item difficulty for students with 
learning disabilities. 


A-7 


Cho et al. 
(2012) 


Using extant data sets, measure whether item characteristics were related 
to item difficulty for state mathematics assessments; also, discern test 
validity by analyzing item functioning and whether it was associated with 
students’ accommodation status (a package of three accommodations: 
read-aloud, frequent breaks, and separate quiet setting) and other demo- 
graphic variables. 


A-7 


(2011) 


Flowers et al. 


Explore the perspectives of students and educators about the testing ex- 
perience; discover possible performance variation in an extant data set of 
students with disabilities using read aloud on paper-and-pencil and com- 
puterized formats; also, clarify whether item difficulty was associated with 
item format; finally, discern construct validity related to the formats of the 
assessment. 


A-1, 
A-2, 
A-7 


Kettler et al. 
(2012) 


Report on students’ perceptions of assessment enhancements; compare 
extant state mathematics assessment data of students with various dis- 
abilities and students without disabilities when using presentation accom- 
modations and calculators; also, compare the effects of modifications and 
accommodations on alternate science (biology) assessment items for stu- 
dents with disabilities who were eligible or not eligible for modified assess- 
ment, along with students without disabilities; finally, determine construct 
validity of the items when using enhancements. 


A-1, 
A-2, 
A-7 


Posey & 
Henderson 
(2012) 


Examine item difficulty of adult education functional reading test items 
using contracted braille and ascertain item reliability; also, compare scor- 
ing patterns of students without disabilities on the test in print format with 
scoring patterns of students with blindness on the test in braille format to 
determine construct validity; finally, analyze test features with expert feed- 
back from adult basic education teachers. 


A-7, 
A-8 


Randall et al. 
(2011) 


Comparing two models’ utility (Many-Facet Rasch Model and Hierarchical 
Generalized Linear Model), analyze state mathematics assessment item 
scores of students with various disabilities and students without disabili- 
ties when using modifications of a basic function calculator and a special 
resource guide, in order to pinpoint items varying in difficulty based on 
multiple variables; also, determine construct validity of the items when us- 
ing modifications under separate conditions. 


(2011) 


Scarpati et al. 


Compare extant state mathematics assessment data of students with vari- 
ous disabilities using presentation accommodations and calculators and 
students without disabilities not using accommodations in order to explore 
differential item functioning; also, ascertain construct validity of the items 
when using accommodations in various combinations. 
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al. (2012) 


students with learning disabilities, at the individual item level and full-test 
levels; also, ascertain the construct validity of computerized format reading 
assessment. 


Authorls Stated Research Purpose Also 
Report about students’ perceptions of read aloud and attitudes about con- 
tent during assessment; compare effects of read aloud on scores on sci- A-1, 
Shelton : ee ane 
(2012) ence assessment from students with and without learning disabilities; also, A-2, 
summarize research findings and this study’s findings in context; finally, A-3 
analyze item-level effects. 
Examine extant data of students with learning disabilities matched by 
ability level for the degree of impact of the computerized and paper-and- 
Taherbhai et | pencil formats of state reading and mathematics modified assessments for A-7 


Table A-7. Purpose Category: Investigate Test Validity under Accommodated Conditions (n=7) 


Author/s 


Stated Research Purpose 


Also 


Abedi et al. 
(2011) 


Investigate the role that certain features of reading test items (cognitive, 
grammatical, lexical, textual/visual) play in leading to these functional 
differences; also, examine the scoring patterns that students with disabili- 
ties and students without disabilities have during reading assessments to 
determine construct validity. 


Cho et al. 
(2012) 


(2011) 


Kettler et al. 
(2012) 


Posey & 
Henderson 
(2012) 


Flowers et al. 


Using extant data sets, measure whether item characteristics were related 
to item difficulty for state mathematics assessments; also, discern test 
validity by analyzing item functioning and whether it was associated with 
students’ accommodation status (a package of three accommodations: 
read-aloud, frequent breaks, and separate quiet setting) and other demo- 
graphic variables. 


Explore the perspectives of students and educators about the testing ex- 
perience; discover possible performance variation in an extant data set of 
students with disabilities using read-aloud on paper-and-pencil and com- 
puterized formats; also, clarify whether item difficulty was associated with 
item format; finally, discern construct validity related to the formats of the 
assessment. 


Report on students’ perceptions of assessment enhancements; compare 
extant state mathematics assessment data of students with various dis- 
abilities and students without disabilities when using presentation accom- 
modations and calculators; also, compare the effects of modifications and 
accommodations on alternate science (biology) assessment items for stu- 
dents with disabilities who were eligible or not eligible for modified assess- 
ment, along with students without disabilities; finally, determine construct 
validity of the items when using enhancements. 


Examine item difficulty of adult education functional reading test items 
using contracted braille and ascertain item reliability; also, compare scor- 
ing patterns of students without disabilities on the test in print format with 
scoring patterns of students with blindness on the test in braille format to 
determine construct validity; finally, analyze test features with expert feed- 
back from adult basic education teachers. 


A-6 


A-1, 
A-2, 
A-6 


A-1, 
A-2, 
A-6 


A-6, 
A-8 
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Authorls Stated Research Purpose Also 
Comparing two models’ utility (Many-Facet Rasch Model and Hierarchical 
Generalized Linear Model), analyze state mathematics assessment item 
scores of students with various disabilities and students without disabili- 
Randall et al. ||. ghee 
ties when using modifications of a basic function calculator and a special A-6 
eo) resource guide, in order to pinpoint items varying in difficulty based on 
multiple variables; determine construct validity of the items when using 
modifications under separate conditions. 
Compare extant state mathematics assessment data of students with vari- 
ous disabilities using presentation accommodations and calculators and 
Scarpati et al. : See : ; ; 
(2011) students without disabilities not using accommodations in order to explore A-6 
differential item functioning; also, ascertain construct validity of the items 
when using accommodations in various combinations. 
Examine extant data of students with learning disabilities matched by 
ability level for the degree of impact of the computerized and paper-and- 
Taherbhai et | pencil formats of state reading and mathematics modified assessments for A-6 
al. (2012) students with learning disabilities, at the individual item level and full-test 
levels; also, ascertain the construct validity of computerized format reading 
assessment. 
Table A-8. Purpose Category: Evaluate Test Structure (n=2) 
Authorls Stated Research Purpose Also 
Compare narrative and expository writing evaluation results of students 
Koutsoftas & with language learning disabilities and students without disabilities; also, M1 
Gray (2012) uncover patterns in assessment results when applying analytic and holistic 
scoring approaches. 
Posey & Hen- Examine adult education functional reading test items using contracted 
braille for item-level validity; also, analyze test features with expert feed- A-6 


derson (2012) 


back from adult basic education teachers. 
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Table A-9. Purpose Category: Identify Predictors of the Need for Test Accommodation/s (n=2) 


Authorls Stated Research Purpose Also 
Investigate the underlying benefits and specific processes of extended-time 
Brown et al. ; : av 
(2011) regarding reading comprehension skills for adolescents with attention-deficit N/A 
hyperactivity disorder (ADHD). 
Examine extant reading and mathematics alternate assessment data from 
students with visual impairments (VI) to compare the varying score results 
Zebehazy et eae 
al. (2012) for students with more and less functional vision; also, analyze the score A-1 
: patterns of students with VI to discern the need for the accommodations that 
they received. 
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Appendix B 


Research Characteristics 


Table B-1. Reference Types, Research Types, Research Designs, Data Collection Sources, and 


Collection Instruments 


Reference Research Research Data Collection 
AUMONS Type Type Design eorecuon Instrument 
yP yP g Source 
Abedi et al. (2011) Report Quantitative ae a Secondary Test 
Alt & Moreno (2012) Journal Quantitative Ques EXperr Primary Observations; 
mental Survey, Test 
Beddow (2011) Journal Mixed aa ha Primary Survey, Test 
Bolt et al. (2011) Journal Mixed me ne Primary Survey 
; é Interview Pro- 
Bouck et al. (2011) Journal Mixed ene Primary tocol, Obser- 
vations 
Brockelmann (2011) Journal Quantitative eine eae Primary Survey 
Brown et al. (2011) Journal Quantitative iit aad Primary Test 
Cawthon (2011) Journal Quantitative aerials Primary Survey 
Cawthon et al. (2012) Journal Quantitative area Secondary Test 
Cawthon et al. (2011) Journal Quantitative puccet au Primary Survey, Test 
Cho et al. (2012) Journal Quantitative uae Secondary Test 
Davis (2011) Dissertation Mixed pies oe Primary Survey 
Engelhard et al. are Quasi-Experi- ‘ 
(2011) Journal Quantitative tenia Primary Test 
NCEO 77 


Data 


Reference Research Research : Collection 
Buinols Type Type Design woleeuen Instrument 
yP yP g Source 
Feldman et al. (2011) Journal Quantitative reas yee Primary Survey, Test 
Flowers et al. (2011) Journal Quantitative pater a Secondary Survey, Test 
Fox (2012) Dissertation | Quantitative uaSrExDells Secondary Test 
mental 
face Descriptive . 
Gregg (2012) Journal Quantitative Quantitative Secondary Articles 
ees Neon Journal Quantitative | Meta-analysis | Secondary Articles 
roe Descriptive 
Hodgson et al. (2012) Report Qualitative Qualitative Primary Focus Group 
Holmes & Silvestri Expository/ Descriptive : 
(2012) Journal Opinion Quantitative Secondary Articles 
; : . neere Descriptive 
lhori (2012) Dissertation | Quantitative Quantitative Primary Survey 
Kettler et al. (2012) Journal Mixed Experimental Primary Survey, Test 
Kettler et al. (2011) Journal Quantitative | Experimental Primary Test 
Kim (2012) Journal Mixed uasl Exper: Primary ie eWE(O; 
mental tocol, Test 
Koutsoftas & Gray nae Quasi-Experi- 
(2012) Journal Quantitative raenital Primary Test 
: Descriptive Interview Pro- 
Kuti (2011) Dissertation Mixed Quantitative Secondary tocol. Test 
Lazarus et al. (2012) Report Mixed Quast E Det Primary HES Bie: 
mental tocol, Test 
nt Ss Descriptive . 
Leyser et al. (2011) Journal Quantitative Quantitative Primary Survey 
: ; eee Descriptive 
Lipscomb (2012) Dissertation | Quantitative Quantitative Primary Survey 
Lovett (2011) Journal Expository! Desciipie Secondary Articles 
Opinion Qualitative 
Makeham & Lee jaucial Qualitative Descriptive Piifiar Interview Pro- 
(2012) Qualitative y tocol, Test 
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Data 


Reference Research Research é Collection 
AuOr= Type Type Design porecuen Instrument 
yP yP g Source 
Meadows (2012) Dissertation | Quantitative ee hale Primary Survey 
Patterson et al. (2011) Journal Mixed Experimental Primary Survey, Test 
He Descriptive 
Phillips et al. (2012) Journal Mixed Qualitative Primary Survey 
Posey & Henderson Correlation/ 
(2012) Journal Mixed Prediction Primary Survey, Test 
Qi & Mitchell (2012) Journal ExROStOny: Longitudinal Secondary Articles 
Opinion 
Randall et al. (2011) Journal Quantitative | Experimental Primary Test 
Scarpati et al. (2011) Journal Quantitative QuaS expen: Secondary Test 
mental 
Schmitt et al. (2012) Journal Mixed Quasl Exper: Primary Survey, Test 
mental 
Schmitt et al. (2011) Journal Quantitative Guest Eel Primary Ebseialens, 
mental Survey, Test 
Interview Pro- 
Shelton (2012) Dissertation Mixed Experimental Primary tocol, Survey, 
Test 
Shinn & Ofiesh (2012) Journal Qualitative Deseipive Secondary Articles 
Qualitative 
Smith & Amato (2012) Journal Quantitative DeScupite Secondary Articles 
Quantitative 
Srivastava & Gray <e Quasi-Experi- A 
(2012) Journal Quantitative "iental Primary Test 
Taherbhai et al. (2012) Journal Quantitative ee ee Secondary Test 
Zebehazy et al. (2012) Journal Quantitative eee Secondary Test 
Zhang et al. (2012) Journal Mixed Qhast EXpen Primary ne FQ: 
mental tocol, Test 
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Data 


Reference Research Research ; Collection 
AUENOES Type Type Design Soreeuon Instrument 
yp yP g Source 

sas Correlation/ . 
Zhou et al. (2012) Journal Quantitative Prediction Primary Survey 

sth Descriptive ; 
Zhou et al. (2011) Journal Quantitative Quantitative Primary Survey 
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Table C-2. Content Areas Assessed 


Authorls 


Math 


Reading 


Writing 


Other LA 


Science 


Social Studies 


Intelligence Test 


Psychology 


Not Specific* 


Abedi et al. (2011) 


Alt & Moreno (2012) 


Beddow (2011) 


Bouck et al. (2011) 


Brown et al. (2011) 


Cawthon et al. (2012) 


Cawthon et al. (2011) 


Cho et al. (2012) 


Engelhard et al. (2011) 


Feldman et al. (2011) 


@? 


Flowers et al. (2011) 


Fox (2012) 


Gregg (2012) 


Gregg & Nelson 
(2012) 


WIN/WIN) PLP I NINN) PP P| re 


wo 


Hodgson et al. (2012) 


Holmes & Silvestri 
(2012) 


Kettler et al. (2012) 


Kettler et al. (2011) 


Kim (2012) 
Koutsoftas & Gray 
(2012) 


ec 


Kuti (2011) 


ef 


Lazarus et al. (2012) 
Lovett (2011) 


Makeham & Lee 
(2012) 


Patterson et al. (2011) 


Posey & Henderson 
(2012) 


Qi & Mitchell (2012) 


Randall et al. (2011) 
Scarpati et al. (2011) 


P|RP/ NX 
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n | @ i 
« 2);)F |] Bl] g 
= 2 > = rs) s 2 2 3 
) s = ¢ = < 4 2 3) ® 
at © 3 = ® ® n 5 2 z 
5 = 5 = s ra) z. o | S ” 
< 4 6/9 /3/2/ 2a) s 
° ® a z 
OE i 3E 
Schmitt et al. (2012) e 1 
Schmitt et al. (2011) e 1 
Shelton (2012) e 1 
Smith & Amato (2012) e 1 
Srivastava & Gray : - 2 
(2012) 
Taherbhai et al. (2012) | e e 2 
Zebehazy et al. (2012) | e ® 2 
Zhang et al. (2012) e 1 
TOTAL 22 19 5 2 4 1 3 0 2 58 


Note: This table encompasses the subset of studies (n=37) which used assessments or tests on academic con- 
tent area/s or cognitive skills; studies that were excluded used surveys or other data collection mechanisms only. 


4 Studies not specifying academic content were reviews of literature regarding a specified 
accommodation’s effect on assessment scores across a various study settings. 
>In this study, other LA = composition of short-answers and essays, in addition to reading. 


¢ In this study from South Korea, native Korean reading skills were tested. 


‘In this study, other LA = English language proficiency, including reading, writing, listening, and speaking. 
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Appendix D 


Participant and Sample Characteristics 


Table D-1. Unit of Analysis, Total Sample Sizes, Grade/Education Level, and Types of 


Disabilities 

Unit of Sample Percent of Grade / Disability Cate- 
Authors . mp Sample with | Education gories Included 

Analysis Size ec enags : 
Disabilities Level in Sample 
Abedi et al. (2011) Students 286023 10% 8th NS, None 
Alt & Moreno ° 
(2012) Students 36 50.0% Ages 5-13 A, None 
Beddow (2011) Students 449 23.0% 7th * ae 
Bolt et al. (2011) Students 55 100% —— LD, S/L 
Bouck et al. (2011) | Students 3 100% — | High: a e vl 
Brockelmann 
(2011) Educators 107 N/A N/A N/A 
Brown et al. (2011) Students 145 100% Ages 13-18 AP 
Cawthon (2011) Educators 372 N/A N/A N/A 
Cawthon et al. ; 
(2012) Students 4350 100% 4th LD 
Cawthon et al. ‘ Sth — 8th; 
(2011) Students 64 100% Ages 10-15 HI 
Cho et al. (2012) | Students 51591 3.4% eet | ay has 
Davis (2011) Educators 288 N/A N/A N/A 
; AP, A, EBD, HI, 
Pnge ner etal Students 1944 57, | Sain Ot 1, ID; PD, Sil, 
(2011) ath Vl 
Feldman et al. 7 EBD, LD, S/L, 
(2011) Students 48 50% 8th Rinne 
Powers eval Students 47404 100% 3rd-1 1th NS 
(2011) 
Fox (2012) Students 441000 100% 3rd, 8th, 11th HI, LD, VI 
Gregg (2012) N/A N/A N/A N/A N/A 
Gregg & Nelson High school to 
(2012) Students 769550 2% adult LD, None 
Hodgson et al. 
(2012) Educators 12 N/A N/A N/A 
NCEO 93 


(2012) 


Unit of S4innia Percent of Grade / Disability Cate- 
Authors 3 mp Sample with | Education gories Included 
Analysis Size ee : 
Disabilities Level in Sample 
Holmes & Silvestri 
(2012) N/A N/A N/A N/A N/A 
lhori (2012) Educators 327 N/A N/A N/A 
Kettler et al. (2012) Students 400 43% High school LD, None 
AP, A, EBD, HI 
° 5] 5] 5] 5] 
Kettler et al. (2011) Students 755 64% 8th LD, Mult., None 
Kim (2012) Students 20 50% Middle school VI, None 
Koutsoftas & Gray | si idents 56 42% Ath-Sth S/L, None 
(2012) 
Educators acta oe eet 
Kuti (2011) , 7010 99.9% 3rd-12th ID, PD, S/L, VI, 
Students 
Mult., None 
Lazarus et al. 
(2012) Students 24 100% 8th NS 
Leyser et al. (2011) | Educators 304 N/A N/A N/A 
Lipscomb (2012) Educators 56 N/A N/A N/A 
Lovett (2011) Students N/A N/A N/A N/A 
Makeham & Lee Siudents 6 100% Postsecond- NS 
(2012) ary 
Meadows (2012) Educators 298 N/A N/A N/A 
aa a Students 216 Unavailable | Youth-adult NS 
Phillips et al. 
(2012) Educators 83 N/A N/A N/A 
Posey &Hender- | Students 147 44% Youth-adult VI, None 
son (2012) 
Qi & Mitchell 
(2012) N/A N/A N/A N/A N/A 
Randall et al. ° 
(2011) Students 868 44% 7th NS, None 
Carpal Gicle Students 73000 16.8% sth NS, None 
(2011) 
Schmitt et al. . Postsecond- 
(2012) Students 3 100% ary LD 
Schmitt et al. . High; ages 
(2011) Students 3 100% 16-17 LD 
Shelton (2012) Students 282 11% 6th, 7th, 8th LD, None 
Sninee Cliesh N/A N/A N/A N/A N/A 
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Unit of Sample Percent of Grade / Disability Cate- 

Authors Rnalysis sae Sample with | Education gories Included 
y Disabilities Level in Sample 

Smith & Amato 
(2012) N/A N/A N/A N/A N/A 
Srivastava & Gray ‘ 
(2012) Students 39 36% 8th LD, None 
Taherbhai et al. ; ‘ 7th-8th, ages 
(2012) Students Unavailable 100% 13-16 LD 
Zebehazy et al. - ; 
(2012) Students 286 100% 3rd-8th ID, VI 
Zhang et al. (2012) Students 4 100% 3rd LD 
Zhou et al. (2012) Educators 840 N/A N/A N/A 
Zhou et al. (2011) Educators 165 N/A N/A N/A 


AP: Attention Problem 

A: Autism 

EBD: Emotional/Behavioral Disability 
HI: Hearing Impairment / Deafness 


NCEO 


ID: Intellectual Disability 
LD: Learning Disability 
PD: Physical Disability 
RD: Reading Disability 


S/L: Speech/Language Disability 
V/|: Visual Impairment / Blindness 
Mult.: Multiple Disabilities 

None: Students without Disabilities 
NS: Disability Not Specified 
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Appendix E 


Accommodations Studied 


Table E-1. Presentation Accommodations ltemized by Study 


Study Author/s 


Clarify 
directions 


Computer 
administration 


Examiner 
familiarity 


Large print 


Alt & Moreno (2012) 


Beddow (2011) 


Bolt et al. (2011) 


Brockelmann (2011) 


Cawthon (2011) 


Cawthon et al. (2012) 


Cawthon et al. (2011) 


Cho et al. (2012) 


Davis (2011) 


Flowers et al. (2011) 


Fox (2012) 


Gregg (2012) 


Hodgson et al. (2012) 


Holmes & Silvestri (2012) 


Kettler et al. (2012) 


Kettler et al. (2011) 


Kim (2012) 


Kuti (2011) 


Lazarus et al. (2012) 


Lipscomb (2012) 


Makeham & Lee (2012) 


Patterson et al. (2011) 


Phillips et al. (2012) 


Posey & Henderson (2012) 


Qi & Mitchell (2012) 


Scarpati et al. (2011) 


Schmitt et al. (2012) 


Schmitt et al. (2011) 


DIO/FPIO/FPIO/O/OIRIJOlPIRBJOolaol/ol/aoloOlBlaloOl/ol/ao;/o|o]0/}|c0|0] 0] Braille 


O/Ol/O;SO;SO;SOSOlSOlSOJ;SOl;RrPSO;SOsSO;SO;/O;/O}/O;SO;SO;O};}/O}O}O;/O;O];rF]}/O 


Ol/Ol/O;SO;SO;SOJLRPIOSO;SO;LRPLSOLO;SO;SO;SOsSO];RIrPILO;SO;SO!RP}|O;O;O;O;F 


DISO/SO/OJOJOJSO/OJRFI|O/O;/OD;/O;O/O/G;G;OJ/O;FJ]O;/O}/O}G}O;O/}/0] | Cueing 


PIF JOLOLO/OSO/D/O/O/OJ/OSOJSOlSG/O/O/O;GQsO/O]/O}/C]C}O]}F] OC} OC} Dictionary 


O/Ol[FJSO;SO;SOlSOSOslSO;SO;SO;SO;SOslSOs;O;/Os;/O}/O;SO;SO;O};/O}R}/O;O;O;0;}0 


CO/SO/OSOSOTRFPIODI/ODID/OJlRPIOl/OD/O/OJSD/O/Ds/O;GD/O}/O;/O}]O}]CG}O0/}O0/] OC} Format 


O}/Ol/FJO;SO;SO;SO;SOJ;RIOLR IFPI O;SO;SO;/O;/O};RFJO;O;O;O};F}/O;O;rR|]O;}oO 
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quid a6.1e7 


a 


yeulo 


Ayrenjiurey 
JaulWeXxy 


Axeuoisiq 


BHulana 


uolyes}siulwpe 
Jajndwoyg 


10 


Suol}DaIp 
AjirelD 


aireag 


Study Author/s 


Shelton (2012) 


Shinn & Ofiesh (2012) 
Smith & Amato (2012) 


Srivastava & Gray (2012) 


Taherbhai et al. (2012) 


Zebehazy et al. (2012) 
Zhang et al. (2012) 


TOTAL 
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Table E-1. [Continued] 


Study Author/s 


Read aloud / 
Oral delivery 


Read 
directions 


administration 


Signed 


Simplified 
language 


Student read 


aloud 


Alt & Moreno (2012) 


Beddow (2011) 


Bolt et al. (2011) 


Brockelmann (2011) 


Cawthon (2011) 


Cawthon et al. (2012) 


Cawthon et al. (2011) 


Cho et al. (2012) 


Davis (2011) 


Flowers et al. (2011) 


Fox (2012) 


Gregg (2012) 


Hodgson et al. (2012) 


Holmes & Silvestri (2012) 


Kettler et al. (2012) 


Kettler et al. (2011) 


Kim (2012) 


Kuti (2011) 


Lazarus et al. (2012) 


Lipscomb (2012) 


Makeham & Lee (2012) 


Patterson et al. (2011) 


Phillips et al. (2012) 


Posey & Henderson (2012) 


Qi & Mitchell (2012) 


Scarpati et al. (2011) 


Schmitt et al. (2012) 


Schmitt et al. (2011) 


Shelton (2012) 


PIPIPIRPLOLOLO/Ol]RPIJOl[RPIOlTRPI]PI]PI] Pl] PlP yep et PI] RPI]olJRPl]ol[RPi]RPilRpip 


se a a ee am a ls eR me me se a Uwe ea ea ke eS a sh a a eS ae a 


O}]O;JO;RPIrPITOLO!LO;]OI;RrRPIO;LOI;O;O!;}lO};]OoOy;o;o;los;o;o;oI;TRrPyo;rPlo;o;rlso 


S|/Oo|eolel|locol]lol]leoeleoe]o]ol!]le le ]oleolP | o]elel]loel]lol|]el]eo]eoel]le|eol]leo]|]el]e |e 


O}1O;JO;O;LOI;lO;O!;}OoOl;]loOsl;lo;o;lrosysyosyol+roalz+loayo;o;loy;oy;rRyol;loyo;yo;oy;yo;yo;o 


CDIDIODIOLOIOlLOI/Ol/OlOlOlOlOlJFRIOL/AOI/Ol/Ol/oOl/Ol[RlLOlalo]l|oa!]o]oO/]F] ©] Visual cues 


PININ/O/|P/RPI/RPI/RPI]RPI/ RB] RP] oO)/wOl/NINI PT RPT PLB IM) |B] RP] RP] oO] eP |] P| @] ol] iN | TOTAL 
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TWLOL 


79 


sano jensip 


pnoye 
peas juapns 


afbenbur| 
payljdwis 


uolyeJ}SIulWpe 
paubis 


suolgaiip 
peay 


AIVAIap [e1O 
| pnoye peasy 


22 


Study Author/s 


Shinn & Ofiesh (2012) 
Smith & Amato (2012) 


Srivastava & Gray (2012) 


Taherbhai et al. (2012) 


Zebehazy et al. (2012) 
Zhang et al. (2012) 


TOTAL 


99 
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Table E-2. Equipment Accommodations Itemized by Study 


Study Author/s 


Computer 
administration 


Physical 
supports 


Technological 


aid 


Alt & Moreno (2012) 


Beddow (2011) 


Bouck et al. (2011) 


Cawthon et al. (2012) 


Davis (2011) 


Flowers et al. (2011) 


Fox (2012) 


Gregg (2012) 


Holmes & Silvestri (2012) 


Kuti (2011) 


Lipscomb (2012) 


Makeham & Lee (2012) 


Patterson et al. (2011) 


Phillips et al. (2012) 


Schmitt et al. (2012) 


Schmitt et al. (2011) 


Shinn & Ofiesh (2012) 


Smith & Amato (2012) 


Srivastava & Gray (2012) 


Taherbhai et al. (2012) 


ml] ile ,o|leol]lelel]lelel]leJloeo!]ele le lel |e]e]Fr 


Cl/OlP IOP PIT RPI]O]RPIJRPI[Ol[RPI]RPI]RPIJolRPIl]olRPilRio 


PliP/ SB PIPPI RPI RPI] RP|/o)/RPI] RPI] PINI/ PIN] RP] RP] &] P| TOTAL 


TOTAL 


NIOLOITRFPILOLOLSOLSO;SO;]OIJRPIO;S/O!]O!]O!]OoO!]O!]O}]O0}] OC} O | Audio cassette 


= 
oO 


WILO;lSO;SO;!OlO;O!;}oOl;]oay;yo;rRPlLol;o;yol;o;oyryo;o;rsyo 


N}JOSO{LRIJO;/OS/OSO/O;O/G;/GQ}O}/GQ}G0}/0/0}0);0]F | O| Screen display 


= 
N 


N 
o 
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Table E-3. Response Accommodations Itemized by Study 


Study Author/s 


Computer 
administration 


Dictated 
response 


Mark answer in 
test booklet 


Speech 


recognition 
system 


Signed 


response 


Alt & Moreno (2012) 


Beddow (2011) 


Bolt et al. (2011) 


Bouck et al. (2011) 


Brockelmann (2011) 


Cawthon (2011) 


Cawthon et al. (2012) 


Davis (2011) 


Engelhard et al. (2011) 


Flowers et al. (2011) 


Fox (2012) 


Gregg (2012) 


Holmes & Silvestri (2012) 


Kuti (2011) 


Lipscomb (2012) 


Patterson et al. (2011) 


Randall et al. (2011) 


Scarpati et al. (2011) 


Shinn & Ofiesh (2012) 


Smith & Amato (2012) 


Srivastava & Gray (2012) 


Taherbhai et al. (2012) 


Zebehazy et al. (2012) 


oe eee) oor lor | oo] rl|e|o)|eo!/r | oe |e) eo] eo) eo) Fr 


FILO/Ol/OlRPIO/OlO/Ol RI BRIO PJoOlo Ri BRlJol/Bl]EPJE]Rio 


Pl/RPIiP/RP/W/RPI RPI RPININ/ WIN) WI RPI RP] RP] Ww) RPI NhM| eo] o)N/ Re | TOTAL 


TOTAL 


DIOlLOLO!/AOIS/OJlRPIRFPIOLRPIOLOI/RPIOAILOI]RPI|O]LO]O]O;]RI|oO!] CO] oO] Calculator 


a= 
o 


= 
ary 


MW] eal olo|lo|]e|o|leo]|o]e!]eo]|oe]_oe!|]oe |e ]|o]el]e | o]e]e |e] |e 


N}TO;};O;O;}O;]O;O!}Ol]O};]O;oO;rRPIEO;o;ol;oy;yos;yo;Toy;yoy;yryol;o;o 


NILO;SOSO;SOJSO;SO/O/OJ;RIJO;/G;O;G}/GO;/O}9O}0}0;}0;0/}F]0] |} Tape recorder 


FLO; O;O;O;OoO;o!;lol;]loa};lo;o;los;y;josyo;+»rosylyoayosyoy+rTrRryo;o;o;l;o;o 


DMIOLOL/O}L/OJLRPISOSOSOISOSOIRPIPIFPIOLOL/O}]/O;/O;rFI]|O}]rFI|]O] OC] Word processor 


h 
So 
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Table E-4. Scheduling Accommodations Itemized by Study 


Study Author/s 


Extended 
time 


Beddow (2011) 


Bolt et al. (2011) 


Brockelmann (2011) 


Brown et al. (2011) 


Cawthon (2011) 


Cawthon et al. (2012) 


Cho et al. (2012) 


Davis (2011) 


Fox (2012) 


Gregg (2012) 


Gregg & Nelson (2012) 


Kim (2012) 


Lipscomb (2012) 


Lovett (2011) 


Phillips et al. (2012) 


Qi & Mitchell (2012) 


Shinn & Ofiesh (2012) 


PlPl]PlPlPlePlePlPlPlolotRPiRpPlRPIJRelRelip 


PIP IPIP IP IP I/RP/@OININ/IPIN/ RPI] RP I]RP |] /N!] TOTAL 


TOTAL 


= 
o 


WlLO;/D/D/DJDJOJoO;RI|RI|R|O|oO;o|/0]0}]0]| °°] Multiple day 


DAILOlSDOISDOS/DOl/OS/OI/Ol[FPIOITRIPIFPI|O]O]O|]F|F | Test breaks 


N 
pS 
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Table E-5. Setting Accommodations Itemized by Study 


Study Author/s 


Specialized 


Individual 
setting 


Beddow (2011) 

Bolt et al. (2011) 
Brockelmann (2011) 
Cawthon et al. (2012) 
Cho et al. (2012) 
Davis (2011) 

Fox (2012) 

Qi & Mitchell (2012) 
TOTAL 
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Appendix F 


Research Findings 


Table F-1. Findings for Studies Examining Effects of Oral Delivery Accommodations (n=5) 


The oral delivery accommodation supported improvement in assessment performance for 
some but not all students with disabilities and/or in some but not all testing conditions (n=3) 


On average, performance on 5 math items was not significantly different with 
the use of the read-aloud accommodation, presented by an in-person reader, 
Lazarus et al. than performance on the other, similar, 5 items without the read-aloud ac- 
(2012) commodation. When reviewed individually, 7 students scored higher with the 
accommodation, 8 students scored higher without the accommodation, and 9 
students scored the same. 


The degree of score improvement across the accommodation conditions was 
not consistent for all participants. The student with the lowest comprehension 
skills, specifically oral fluency, demonstrated the most benefit of the three par- 
ticipants when using the reading pen, in both conditions. However, when using 
the reading pen for vocabulary definition, she mostly scored lower than when 
using the oral delivery-only tool setting. The other two participants’ comprehen- 
sion skills actually worsened when using the reading pen than when not doing 
so, which the researchers attributed to those participants having difficulties 
manipulating the reading pen and disrupting their reading fluency. 


Schmitt et al. 
(2012) 


All three students scored lowest on comprehension accuracy when using the 
reading pen for decoding and vocabulary. Two of the three students exhibited 
the highest comprehension accuracy (with a small effect size) when using the 
reading pen for decoding, and one scored highest (with a moderate effect size) 
without the accommodation. When calculating comprehension rates, or correct 
answers per minute of reading time, all three students had the lowest rates in 
the decoding and vocabulary condition. Two students had the best rates in the 
control condition and one student had the best rate in the decoding condition. 
Comparing the rates for the control condition to the decoding condition, the two 
scoring highest in the control condition had moderate effect sizes, whereas the 
student with the highest rate in the decoding condition had a small effect size. 
Overall, then, the researchers concluded that the reading pen accommodation 
was not consistently beneficial for these students on grade-level test materials. 


Schmitt et al. 
(2011) 


The oral delivery accommodation supported improved assessment performance and in 
other ways beyond for students with learning disabilities (n=1) 


The results of this literature review indicated that text-to-speech supported 
reading, benefiting comprehension, reading rate, and task persistence. The 
Holmes & Silves- | degree of benefit in some areas depended on the degree of reading disabilities, 
tri (2012) in that those with more difficulties exhibited improvements more than those with 
fewer difficulties. For instance, people with phonological processing challenges 
were aided more than others. 
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The oral delivery accommodation supported improved assessment performance of all stu- 


dents (n=1) 


Shelton (2012) 


Students using oral delivery accommodations, via audio recording, scored a 


higher total score than students not using read-aloud for one of the science 
content modules, but no difference in scores for the other science content mod- 
ule tests. When controlling for learning disability status, there were no score 
differences in any of the modules. 


Table F-2. Findings for Studies Examining Effects of Computerized Accommodations (n=3) 


The computer administration accommodation did not support improved scores for students 
with disabilities more than the paper assessment format (n=2) 


Patterson et al. 
(2011) 


Srivastava & Gray 
(2012) 


The researchers demonstrated the feasibility, at least on a small scale, of shift- 
ing the mode from paper to electronic computer-based format. For the test- 
takers using paper-based then computerized tests, there were no significant 
differences in final test scores. In other words, the 25 test-takers using Nimble- 
Tools on computerized tests scored higher than test-takers had on the accom- 
modated paper tests, although the difference was not statistically significant. 


Students without disabilities scored significantly higher than students with 
language-learning disabilities (LLD). The scores of students without disabili- 
ties were not significantly different between testing conditions. The students 
with LLD experienced the same pattern—no score differences between test 
formats. This was an unexpected result, as it was hypothesized that the 
computerized format with hyperlinked vocabulary definitions would increase 
students’ cognitive load. The researchers reviewed possible factors related 
to the finding, as well as the observation that students with LD did not often 
stop reading and review hyperlinked text. The mean passage-reading times 
and item response times across testing conditions did not differ significantly 
between students with and without LD, although students with LD tended to be 
somewhat slower. 


The computer administration accommodation did not support improved scores for all stu- 
dents (n=1) 


Alt & Moreno 
(2012) 
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There were no significant differences in scores between the test formats for 
students with autism spectrum disorders (ASD) and students without dis- 
abilities. In fact, the reliability across the two test formats was high for both 

the expressive and receptive tests for both groups. However, the scores of 
students without disabilities were higher on both tests than scores of students 
with ASD. All students scored higher on the expressive test than on the recep- 
tive test. Neither group had observable differences in behavior between the 
paper-based and computer-based formats. The behavioral ratings were higher, 
indicating more negative behaviors, for the students with ASD than for students 
without disabilities. 
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Table F-3. Findings for Studies Examining Effects of Extended-time Accommodations (n=3) 


The extended-time accommodation supported improved scores for students with disabilities 
(n=1) 


Participants—who all had Attention Deficit Hyperactivity Disorder (ADHD)—had 
Verbal Comprehension Index (VCI) scores in the high-average range, and 
their Working Memory Index (WMI) and Processing Speed Index (PSI) were 
lower, in the average range—all of which fits with scores typical of students with 
ADHD, as these are difficulties in executive functions related to ADHD. On the 
standard timed Nelson-Denny Reading Test (NDRT), about 48% of participants 
failed to attempt all of the vocabulary items, and about 53% of participants 
Brown et al. failed to attempt all of the reading comprehension items. Participants’ NDRT 
(2011) scores without extended-time, on average, were significantly lower than when 
provided extended-time. Put another way, about 63% of participants’ NDRT 
scores, without extended-time, were within one standard deviation (SD) of their 
VCI score, and for reading comprehension items, about 43% of the scores were 
within 1 SD of VCI scores. However, with extended-time, about 73% of partici- 
pants’ (NDRT) vocabulary scores within 1 SD of their VCI scores, and about 
78% of participants’ (NDRT) comprehension scores were within 1 SD of their 
VCI scores. 


The extended-time accommodation supported score improvements differentially for stu- 
dents with disabilities compared to those of students without disabilities (n=1) 


This meta-analysis examined nine studies, ranging from 1986 to 2006, yet em- 
pirical conclusions pertaining to extended-time drew from fewer studies. Three 
studies indicated that youth with learning disabilities scored significantly higher 

Gregg & Nelson _| with extended time than without, with medium to large effect sizes. Two studies 

(2012) found that youth without disabilities also scored moderately higher with accom- 
modations, with small to large effect sizes. Two studies supported the differen- 
tial boost hypothesis, indicating the benefits from extended-time were greater 
for youth with learning disabilities than youth without disabilities. 


The extended-time accommodation has supported improved scores for all students (n=1) 


The author argued that there are four main findings that should be considered 
before allowing the use of extended-time testing accommodations, including 
that extended time has helped non-disabled students as well as students with 

Lovett (2011) disabilities, and that extended-time has been changing the meaning of students’ 
test performance. The author concluded by suggesting steps that practitioners 
can take in order to recommend the extended-time accommodation only when 
appropriate. 
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Table F-4. Findings for Studies Examining Effects of Calculator Accommodations (n=2) 


The calculator accommodation supported improved performance for all students (n=1) 


Calculator use seemed to result in a small increase in the mean scores of 
students with and without disabilities in both age groups in most cases. No 
Engelhard et al. support was found in this study for the interaction hypothesis (no evidence 
(2011) that the accommodations were reducing construct-irrelevant barriers to the 
achievement of students with disabilities). Overall, students without disabilities 
experienced larger gains in scores than students with disabilities. 


The calculator accommodation had mixed results for students with disabilities (n=1) 


On state math assessments, the calculator accommodation provided a dif- 
Scarpati et al. ferential boost on some items for students with disabilities, whereas not using 
(2011) accommodations for some items provided a differential boost for students with 
disabilities. 


Table F-5. Findings for Studies Examining Effects of Aggregated Accommodations (n=3) 


Accommodations package supported improved scores for all students in an equal manner 
(n=1) 
Packages of accommodations individualized to the needs of each student with 
disabilities and could include any combination of the following: unlimited time 
(similar to extended-time), highlighting test directions, read-aloud directions 
only, test books in large-print format, student dictation to a human scribe, and 
allowing frequent rest breaks. Note: Each student with disabilities was paired 


with a student without disabilities, who received the same package of accom- 


(2011) 


Results also showed that students with disabilities performed significantly 
worse than students without disabilities on the test. All students performed 
better when given testing accommodations, and no interactions were found 
between groups and conditions, suggesting that students with disabilities and 
students without disabilities benefitted equally from each distinct accommoda- 
tions package. 
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An accommodations package supported improved scores for students with disabilities more 
than another accommodations package (n=1) 


Packages: computerized format with oral delivery accommodation via text-to- 
speech software vs. print text format with human reader. 


Results showed no differences in effect sizes between grade levels, suggesting 
that there were no differences across grade/school levels. There were differ- 

Flowers et al. ences in effect sizes between academic subjects, with larger effect sizes found 

(2011) for reading than for math or science. There were small to moderate differences 
between paper-and-pencil test and computer-based test conditions that tended 
to favor the paper-and-pencil test condition. The researchers noted that scores 
were generally lower in the computer-based testing condition, but that this trend 
may have been due to extraneous factors. 


Accommodations package supported improved scores for students with disabilities (n=1) 


Package: oral delivery accommodation via human reader in combination with 
large print, braille, and extended time. 


Kim (2012) Students with visual impairments scored significantly better when using the 
read-aloud accommodation along with other accommodations than when using 
other accommodations alone. The other accommodations typically used by 
these students were large print, braille, and extended-time. 


Table F-6. Findings for Studies Examining Uncommon or Unique Accommodations and 
Modifications (n=7) 


The unique accommodations did not support improved performance for students with dis- 
abilities (n=2) 

The voice-input, soeech-output (VISO) calculator, using aspects of speech-rec- 
ognition and dictated-response accommodations, required more time and more 
item attempts to complete calculations on math assessment items than did the 
typical strategies of students with visual impairments. 


Bouck et al (2011) 


No significant differences were found in overall performance between the writ- 
ten English for items and ASL for items, in either reading or mathematics. ASL 
exposure was largely not a significant predictor of performance. 


The unique accommodations supported improved performance for students with disabilities 
(n=2) 


Cawthon et al. 
(2011) 


The results of this literature review highlighted in two studies indicated that 
Holmes & Silvestri | word-processing assisted writing outputs for postsecondary students, improv- 
(2012) ing spelling error detection, increasing GPAs, and changed course completion 
to a rate similar to students without disabilities. 


Grade 3 students with math disabilities scored significantly better on geometry 
assessment items with the visual chunking accommodation—which supported 
visual memory—than without it. 


Zhang et al. 
(2012) 
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The unique enhancement did not support improved performance for all—students with dis- 
abilities as well as students without disabilities (n=1) 


Results showed that math resource guides, providing definitions of academic 
terms as well as graphics, were not an effective accommodation for stu- 
dents with or without disabilities. No support was found in this study for the 
interaction hypothesis (no evidence that the accommodations were reducing 
construct-irrelevant barriers to the achievement of students with disabilities). 
Overall, students without disabilities experienced larger gains in scores than 
students with disabilities. 


The unique enhancement supported improvements differentially for a subset of students 
with disabilities (n=1) 


When the modifications were examined separately, for the sets of math and 
reading assessment items, the modification of shortening the item stem dif- 
ferentially benefited students with disabilities who were identified as eligible for 
modified assessments, compared to students with disabilities not eligible for 
modified assessments, and to students without disabilities. 


Engelhard et al. 
(2011) 


Kettler et al. 
(2011) 


The unique enhancement did not support improvements differentially for a subset of stu- 
dents with disabilities (n=1) 

When the modifications were examined separately, for the sets of reading 
assessment items, the modification of adding graphics did not differentially 
benefit students with disabilities who were identified as eligible for modified 
assessments, compared to students with disabilities not eligible for modified 
assessments, and to students without disabilities. 


Kettler et al. 
(2011) 


Table F-7. Findings for Studies Examining Perceptions about Accommodations and 
Modifications (n=25) 


STUDENT PERCEPTIONS ONLY (n=13) 


Students indicated that using accommodations and/or modifications benefited them in 
terms of performance score (n=4) 


The survey findings included that all students comprehended the modified math 
items better than the standard math items. Students without IEPs comprehended 
Beddow (2011) | items (both standard and modified forms) better than the students with IEPs. 
All students reported that they had to work less to answer modified items than 
standard items. Similarly, students without IEPs indicated a lower degree of cogni- 
tive load than students with IEPs indicated, for both modified and standard items. 
Students also offered their perceptions of their having learned the content, and 
confidence in being correct on the items. 


Kettler et al. The test-takers mostly indicated that the enhancements (accommodations or 

(2012) modifications) seemed to decrease the difficulty of science testing, but when 
viewing specific original items and enhanced items, they indicated that each item 
had a similar level of difficulty. 
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Lazarus et al. 
(2012) 


Zhang et al. 
(2012) 


Most of the students (61%) reported that using read-aloud reduced stress associ- 
ated with test taking, and/or helped them arrive at correct answers on the math 
test, yet only 7 of the 24 students scored higher when using this accommodation. 


Participants also reported a preference for visual chunking representation on 
geometry assessment items, and reported that the items were easier when using 
visual chunking. 


Students indicated that using accommodations benefited them beyond performance score 


improvements (n=4) 


Bouck et al. 
(2011) 


Feldman et al. 
(2011) 


Patterson et al. 
(2011) 


Shelton (2012) 


Two of three student participants expressed they felt more independent using the 
voice-input, speech output calculator because they did not have to rely on a hu- 
man access assistant during math assessment. 


Results indicated that the accommodations package had an effect on test-related 
thoughts and attitudes, regardless of disability status. For example, students 
who received accommodations showed larger increases between the pre- and 
post-test on measures of self-efficacy than students who did not receive accom- 
modations. For students with disabilities, receiving accommodations appeared 

to increase motivation to work hard during reading/language arts assessment, 
whereas for students without disabilities this was not the case. 


Survey results indicated that 61% of participants preferred to take the GED math 
examination via computer, and that 61% preferred to use NimbleTools rather than 
be tested on paper. Also, about 75% of participants indicated that it was easy to 
use the NimbleTools. 


Students indicated on surveys about their generally positive perceptions about the 
oral delivery testing condition. An example survey question asked about partici- 
pants’ use of oral delivery, specifically of listening to the characters explain sci- 
ence problems. Most test takers (87%) indicated that they had done so to varying 
degrees from very much to very little, and only 13% responded that they did not 
do so at all. Another survey item inquired about the degree to which the char- 
acters speaking was distracting; 34% responded that they disagreed and 22% 
responded that they strongly disagreed with that notion, and about 27% indicated 
a neutral response about distractedness. Only 17% indicated that they were dis- 
tracted by the characters speaking. Students with learning disabilities tended to 
have a more positive perception of hearing the segments of characters speaking, 
and tended not to find them distracting but rather useful to form their test answers. 


Student perceptions were mixed about the accommodations studied (n=3) 


Makeham & 
Lee (2012) 
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The results were primarily reported as categorized qualitative data about students’ 
perceptions. All participants indicated social discomfort, including embarrassment, 
when offered a human exam reader. In comparison with a human reader, many 
participants stated a preference for iPod aural presentation. Two of the three 
math examinees were also the two students reporting the greatest benefit with 
the iPod. Compared with having only printed exams, they noted that this recorded 
read-aloud exam supported their needs for understanding what was being asked 
of them by the additional cues of intonation and pacing. Three of the students 
reported little or no benefit from using the iPod-presented oral delivery, compared 
with printed exam alone; their comments indicated that this accommodation (oral 
delivery) via any medium would not be helpful to them. 
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Schmitt et al. 
(2012) 


Schmitt et al. 
(2011) 


There seemed to be an inverse relationship between actual benefits and enjoy- 
ment of using the reading pen: the lowest-skilled participant indicated a lesser 
degree of satisfaction than the other two participants. 


Two high school participants with learning disabilities reported that they enjoyed 
using the reading pen accommodations during reading task, while one other did 
not enjoy this technology. All three students indicated that the decoding function 
was helpful for unknown words, yet one indicated that the vocabulary (definition) 
function was helpful only for unknown words. 


Students expressed a preference for one or more accommodations over one or more others 


(n=2) 


Bolt et al. 
(2011) 


Kim (2012) 


In terms of degree of helpfulness, participants using certain accommodations indi- 
cated that these were most helpful: in high school, extended-time, dictionary use, 
and dictated response to a scribe; in college, dictated response to a scribe and 
word processor with spell-check. In terms of barriers to accommodations use, the 
largest proportion (36%) of participants indicated that underlying reasons were 
system-level issues, such as accessing support, specifying appropriate accom- 
modations, and documentation of diagnosis, among others. Other barrier catego- 
ries (besides systems issues) were oneself (19%)—embarrassment and failing to 
advocate, and others (17%)—lack of knowledge or negative attitudes. Facilitators 
of accommodations use, in order of proportion of participants endorsing them, 
included: other individuals (34%), system-level issues (32%), and self (7%). 


Students with visual impairments expressed a preference for using oral delivery 
when presented by a human reader, noting that they moved more slowly through 
the reading test items when using either braille or magnification alone, and that 
they had difficulties with reading long text passages. Almost all students without 
disabilities reported that they were more comfortable not using read-aloud accom- 
modations, noting that their reading speed was faster than the rate of read-aloud 
accommodation. 


EDUCATOR PERCEPTIONS ONLY (n=11) 


Educators had similarly positive or supportive attitudes about accommodations and/or 
modifications (n=3) 


lhori (2012) 
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There were no significant differences in survey response patterns of faculty par- 
ticipants based on being at two-year or four-year institutions, nor any differences 
based on being at public or private four-year institutions. That is, faculty members 
had similar attitudes and beliefs about students with ADHD, similar knowledge 
bases about legal protections for students with ADHD, and similar willingness to 
accommodate students with ADHD. A small proportion—10-20% or so—of the 
survey responses across the participant population indicated limited knowledge 
about aspects of accommodations. For example, about 20% indicated disagree- 
ment with accommodating students with ADHD on the response method for ex- 
ams, and 25% expressed disagreement with permitting laptop, calculator, or spell 
checker during exams. 
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Leyser et al. 
(2011) 


Lipscomb 
(2012) 


There were some demographic differences between the 1996/7 cohort and the 
2006/7 cohort, namely more respondents with advanced degrees, and older mean 
age of respondents. No major differences were found, however, in faculty willing- 
ness to provide students with accommodations, faculty attitudes toward accom- 
modations remaining positive over the last ten years. The findings also revealed a 
need for training in the area of disabilities, and a need for increased contact with 
the Office of Special Services (OSS). 


First of all, there were no overall differences in positivity or negativity about the 
accommodations or modifications that the checklist identified, although the gen- 
eral education teachers rated all adaptations as more effective than the special 
education teachers did. Specific adaptations rated significantly more highly by 
general educators than special educators included read aloud and modified test 
grading. General educators provided responses about fewer accommodations, 
and the researcher suggested that this phenomenon may have been related to 
lack of familiarity with some accommodations listed, or perhaps a perception that 
some accommodations were not available. When comparing perspectives of 
female regular education teachers and female special education teachers, there 
were no apparent differences overall regarding their views of the effectiveness 

of the adaptations for students with LD. However, there were some perception 
differences about specific adaptations, including that female regular educators 
rated modified tests more favorably than female special educators did. Due to few 
female special educators participating in the study, some score differences could 
not be reported. Finally, comparisons between male general educators and male 
special educators could not be reported with reliability due to there being only two 
male special educators. 


Educators had varying degrees of positive or supportive attitudes about accommodations 
and/or modifications (n=3) 


Brockelmann 
(2011) 


Davis (2011) 
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The most broadly used assessment accommodations included extended-time for 
exams and using a private testing space, such as in the testing center, and the 
least commonly used assessment accommodation was alternate test format. Of 
the strategies rated as most effective, the assessment accommodation identified 
was extended-time for exams. When comparing the subset of participants who 
were STEM or non-STEM faculty, each group used a similar average number of 
strategies, but the types of strategies differed. STEM faculty members used the 
following significantly more frequently than non-STEM faculty members: extend- 
ed-time for exams, using a private testing room, and changing the form or format 
of the exam—permitting read-aloud, dictated, typed, or scribed. When comparing 
the STEM and non-STEM faculty about their effectiveness ratings of assessment 
accommodations, STEM faculty members rated extended-time for exams as more 
effective than non-STEM faculty members rated that accommodation. 


Educators reported that accommodations have facilitated students with disabili- 
ties demonstrating their knowledge, and that accommodations have supported 
students with disabilities by individualizing instruction and assessment. Educa- 
tors also reported that accommodations have shown limited benefit and provided 
more support than needed and to the detriment of students. 
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Meadows 
(2012) 


General education teachers had an overall more positive attitude than special 
education teachers toward instructional and assessment accommodations. 
Special education teachers had a more positive attitude, across all grade levels, 
toward both types of accommodations. When comparing teachers with at least 
masters degrees with teachers without master’s degrees, the former had more 
positive attitudes than the latter toward assessment accommodations. However, 
those with masters’ degrees had no difference in attitudes toward instructional 
accommodations. Teachers with at least 16 years of work experience had more 
positive attitudes toward all accommodations than those with less work experi- 
ence. Teachers of elementary students had more positive attitudes than others to- 
ward instructional accommodations, but there were no attitude differences among 
teachers’ grade level clusters about assessment accommodations. Attitudes were 
more positive about instructional accommodations than assessment accommo- 
dations. When comparing use of five specific accommodations—extended-test 
time, seating preference, segmenting assignments, small group instruction, and 
read-aloud of assessments or assignments—all teachers concurred that the most 
commonly offered accommodations were extended test time and read-aloud of 
assessments or assignments. 


Educators indicated that they had various levels of familiarity or knowledge about accom- 
modations (n=3) 


Phillips et al. 
(2012) 
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Almost one-quarter (24%) of the faculty participants reported having provided on- 
line course testing accommodations (extended-time, alternate test formats, and/ 
or assistive technology) to students with disabilities that were verified by Disability 
Services, and 15% had provided online accommodations for students who self- 
reported their disabilities to the faculty members. Most faculty participants (53%) 
had substantial experience with online courses (requiring no assistance with man- 
aging technology), yet a majority of participants (54%) were uncertain about their 
capability to manage providing online accommodations, with only about one-third 
(34%) of faculty indicating that they were capable of doing so. Of those faculty 
members who had provided online accommodations, most indicated their percep- 
tion that there had been no change in the nature or degree of student requests for 
accommodations throughout faculty members’ time at the institution. In fact, they 
indicated that students already used accommodations from their own resources, 
chose not to use accommodations, or chose not to request accommodations from 
the university. Further, some participants indicated their views that implementing 
universal design principles addressed students’ needs without accommodations. 
Recommendations from participants centered on the need of both faculty and 
students for ongoing institutional support regarding accommodations for online 
courses. 
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The participants rated themselves as having various degrees of confidence in 
teaching with assistive technology: about 10% were very confident, 31% were 
confident, 39% had some confidence, 19% had limited confidence, and about 1% 
had no confidence. For the assessment competency, Domain 8, the mean score 
was 2.47, signifying that on average the participants estimated that they had 
basic knowledge and skill. Participants had the lowest levels of knowledge/skill 

Zhou et al. in: deaf-blindness and AT use, foundations of AT, and use of refreshable braille, 

(2012) use of Nemeth code translation software, and funding professional development 
in AT. An implication discussed was that students may not have been receiving 
instruction in using refreshable braille, due to their educators’ insufficient knowl- 
edge. Participants had proficiency or advanced levels of knowledge/skill in: using 
student data in designing instruction, using closed-circuit TV in instruction, col- 
laborating on multidisciplinary teams, using standard braille-writers, and teaching 
AT to students individually or in groups. 


Participants, who taught students with visual impairments, indicated that their 
levels of expertise on 55 of the 74 assistive technology (AT) competencies were 
significantly lower than the expected levels of expertise. Of the 6 domains of 
knowledge and skill, survey respondents had sufficient expertise in only the learn- 
ing environments domain. Put another way, about 58% of respondents indicated 
less than adequate confidence in teaching assistive technology to students. 
Respondents indicated that they were sufficiently familiar with AT devices such as 
closed-circuit television (CCTV), handheld and stand magnifiers, and telescopes, 
as well as common technologies used by the general population of students; how- 
ever, they were not appropriately expert in any other AT devices (e.g., augmented 
communication devices, braille note takers and writers, braille and Nemeth code 
translation software, personal digital assistants/PDAs, screen-readers, tactile 
graphics devices, talking calculators, and talking dictionaries). Further, survey 
respondents were limited in their knowledge of appropriate resources for improv- 
ing their AT expertise. When examining participant demographics, researchers 
found a small positive relationship between higher numbers of years working with 
students with visual impairments and their expertise levels. 


Educators indicated that using accommodations benefited students beyond performance 
score improvements (n=1) 


Test administrators had views that the oral delivery accommodation, presented by 
test administrators, provided a range of benefits. In addition to supporting reading 
and providing access to tests, oral delivery can assist with focus when students 
have difficulty with testing endurance and motivation, and can decrease concen- 

Hodgson etal. | tration if administrator’s reading pace differs with students’ pace. In comparison 

(2012) with other academic content tests, read aloud provided during math tests differed 
in how it was implemented. For example, participants indicated that administration 
of read aloud on math tests required more training and math content familiarity, in 
order to limit inadvertent pronunciation mistakes and variations in following guide- 
lines across administrators. 


Zhou et al. 
(2011) 
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Educators indicated that they had moderate to high levels of knowledge about accommoda- 
tions (n=1) 


The level of knowledge of the general education teachers about accommodations 
was moderate to somewhat high to high overall, depending on category—pre- 
sentation, response, time and scheduling, and setting. The presentation category 
included read aloud, oral delivery into recording device and play back to self, oral 
administration by test administrator, blank marker to keep place on test and on 

Davis (2011) answer document, amplification device, and colored overlays and markers for 
notes on colored overlays. Response accommodations were scribe, supplemental 
aide, and blank graphic organizer. The time and scheduling category included 
testing across two days; frequent or extended breaks; and verbal, visual, or tactile 
reminders for staying on-task. Setting accommodations were minimizing distrac- 
tions and individual administration. 


EDUCATOR AND STUDENT PERCEPTIONS (n=1) 


Students with disabilities and their teachers indicated students’ preference for using one 
accommodation package over another (n=1) 


Teachers and students both reported that students preferred the computerized 
Flowers et al. format with oral-delivery accommodation via text-to-speech reader over the 
(2011) printed text format with a human reader (although the results did not support bet- 
ter performance in this condition). 


Table F-8. Findings for Studies Examining the Implementation and Use of Accommodations 
(n=13) 


Implementation challenges and atypical use patterns affected accommodations practices 
(n=3) 


Educators’ implementations of practices were associated with training, identity 
demographics, and grade levels of instruction. The participants reported they 
have engaged in moderate to high levels of practices which have made accom- 
modations effective. The barriers that participants reported about using ac- 
Davis (2011) commodations included the concern reported by students with disabilities that 
they felt conspicuous about using accommodations, the difficulty of class size 
limiting teachers’ capacity to assist all students including those with and without 
disabilities, limited staff and funding, limited time, teachers’ lack of understand- 


ing disabilities and appropriate accommodations, and the need for training to 
address implementation barriers. 


A small proportion of faculty participants—10-20% or so—of the survey re- 
sponses across the participant population indicated limited knowledge about 
thori (2012) aspects of accommodations. For example, about 20% indicated disagreement 
with accommodating students with ADHD on the response method for exams, 
and 25% expressed disagreement with permitting laptop, calculator, or spell 


checker during exams. 
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Phillips et al. 
(2012) 


Only one-fourth of faculty member participants reported that they had been 
asked by students to provide accommodations in online courses, and approxi- 
mately two-fifths (43%) of faculty member participants reported that they had 
never been asked to provide accommodations to students in online courses. 
Accounting for the relative infrequency of being asked to provide accom- 
modations, faculty members indicated their observations that students have 
already been using accommodations from their own resources, chose not 

to use accommodations, or chose not to request accommodations from the 
university. The researchers also provide a schematic about accommodations 
that were typically provided to students based on the nature of their disabilities; 
for instance, students with learning disabilities were provided extended testing 
time and assistive technology, among others, and students with communication 
disorders were provided alternate testing format. 


Common accommodations for students with visual impairments on reading included large 
print and extended-time (n=3) 


Fox (2012) 


Kim (2012) 


Smith & Amato 


(2012) 
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For students with visual impairments (VI), the most commonly used accom- 
modation in both math and reading for the three test years was large print, 
followed in popularity by small group, separate room (individual), and extended 
time. For only some students with VI, there were a few patterns of accommoda- 
tions bundles in either reading or math, such as large-print and extended-time 
and magnification and administrator-transcription and sometimes dictated-re- 
sponse. Another bundle used consistently across years for some students was 
braille and extended-time and separate room (individual) and dictated-response 
and sometimes braille writer. However, from a longitudinal view of accommo- 
dations use, there were very few trends across years in the number or type of 
accommodations; that is, students typically might be provided specific accom- 
modations in one year but different accommodations in another. 


Students with visual impairments typically used the oral delivery accommoda- 
tion in combination with large print, braille, and extended-time on reading as- 
sessments in South Korea. 


Only two of five timing and scheduling accommodations were specific to 
students with visual impairments, though it was not often stated explicitly that 
these students may need such accommodations. Most states provided small 
group and lighting adjustment accommodations, though these were not unique 
for students with disabilities. Most states allowed scribes or other necessary 
response modifications, though it was surprising that electronic note-takers or 
PDAs were not more widely used. All states provided braille and large-print ac- 
commodations for students with visual impairments, but fewer allowed an aba- 
cus or talking calculator even when other students were allowed to use scratch 
paper. Other presentation accommodations were allowed even less frequently. 
The authors concluded that there was some lack of vision-specific accommo- 
dations in state manuals, which have presented challenges for students with 
visual impairments. 
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The most common accommodation provided to students with disabilities was extended-time 


(n=2) 


Bolt et al. (2011) 


Lovett (2011) 


About half of the participants (N=30) received accommodations through special 
education and/or Section 504 services in high school, as well as in college, with 
the remainder accessing accommodations only at the postsecondary level. In 
both the high school and postsecondary levels, the rank order of commonality 
of accommodation category was: scheduling accommodations, setting accom- 
modations, presentation accommodations, and response accommodations. 
The most common single accommodation used at both levels was extended- 
time, followed by individual setting. It was more common to be provided via oral 
delivery using a human reader in high school, and more common via computer 
using text-to-speech software in college. 


The author argued that there are four main findings that should be considered 
before allowing the use of extended-time testing accommodations, including 
that decisions about extended-time have not been made consistently, and that 
providing accommodations has been taking the focus away from providing 
interventions. The author concluded by suggesting steps that practitioners can 
take in order to recommend the extended-time accommodation only when ap- 
propriate. 


The oral delivery accommodation has had variations in its implementation (n=2) 


Hodgson et al. 
(2012) 


Holmes & Silves- 
tri (2012) 
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Researchers found that this state is similar to many others which have provided 
oral delivery using human readers on state mathematics assessments as one 
of the most frequent accommodations offered. The researchers found that 
there were variations in administration practices—some arranged small-group 
or individual space for providing oral delivery, and some provided oral delivery 
to students with similar reading pacing needs. In comparison with other aca- 
demic content tests, oral delivery provided during math tests differed in how it 
was implemented. For example, participants indicated that administration of 
oral delivery on math tests required more training and math content familiarity, 
in order to limit inadvertent pronunciation mistakes and variations in following 
guidelines across administrators. In comparison with other accommodations, 
oral delivery was used more often than accommodations such as breaks, cal- 
culator, enlarged print, and scribe, among others. Additionally, oral delivery was 
provided in combination with other accommodations such as alternative setting 
or frequent breaks, due to the circumstances of having a person read the test 
aloud, rather than because those other accommodations were identified in the 
individualized education program (IEP) plan. 


In this literature review identifying needs of postsecondary students and the 
ways assistive technology (AT) is used to address them, the researchers 
indicated that AT for reading could include software programs with functions 
such as text-to-speech, optical character recognition (OCR), and synthesized 
speech; for writing, software functions could include speech- or voice-recogni- 
tion, word-prediction, and mind-mapping and outlining. More research atten- 
tion was paid to AT studies examining impacts on reading, and little or none on 
writing. 
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Various factors complicated the provision of accommodations to students at the postsec- 
ondary level (n=1) 


Fitting with the cognitive issues being reviewed, the researchers described both 
universal design and accommodations solutions, including for access de- 
mands, font size, text-to-speech software, and other presentation and appear- 
ance-based aspects; and for output demands, extended time, word processing 
and keyboard composition via computer access, and dictation software. The 
researchers presented a model for training university instructors to implement 
universal design and accommodations. 


Shinn & Ofiesh 
(2012) 


Common accommodations for students with hearing impairments included sign language 
interpretation and extra time (n=1) 


Findings revealed that the most common accommodations recommended for 
students with hearing impairments were test directions interpreted, extra time, 
and test items interpreted. Findings also revealed that recommendations for ac- 
commodations differed by subject (math vs. reading) and by student proficiency 
(high skill level vs. low skill level), but communication mode (ASL vs. Total 
Communication) was not a significant factor in choosing accommodations. 


Accommodations use patterns differed among students with visual impairments (n=1) 


From among students with visual impairments who participated in the state 
alternate assessments in math and reading, students with more functional vi- 
sion performed better overall than students using vision for some or no tasks. 
Students using more vision to complete tasks also received fewer accommoda- 
tions, though students with less vision sometimes did not receive accommoda- 
tions as well, which may present a problem of accessibility and availability of 
accommodations. 


Cawthon (2011) 


Zebehazy et al. 
(2012) 


Table F-9. Findings for Studies Analyzing the Validity of Accommodations or Modifications Use 
on Assessments (n=8) 


The accommodations did not change the construct/s (n=3) 


The computer administration accommodation with text-to-speech software 
package did not change the academic constructs of reading, science, and 
mathematics on the state assessment. 


There were no significant differences in reading skills assessment scores be- 
tween the group of students with visual impairments and the group of students 
without disabilities. Put another way, the use of contracted braille for the test 
items permitted students with visual impairments to access the test and perform 
at a level commensurate with students without disabilities. 


Flowers et al. 
(2011) 


Posey & Hender- 
son (2012) 
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The accommodations did not change the construct/s (n=3) 


At the test level, there were no significant differences between scores on the 
paper and pencil and online test modes, for both math and reading; that is, the 
online test mode did not benefit students with learning disabilities more than 
the paper-based testing condition. At the item-level, some individual items in 
both grade levels and both content areas behaved differently between the test 
modes. The paper-based format benefited students with disabilities on only a 
couple of the paper-based math items, and the online format benefited par- 
ticipants on a few more of the math and reading items, all at a moderate level 
of differential item functioning (DIF). However, the researchers note that the 
number of items showing these differences were fewer than might occur by 
chance, and item content analysis by experts indicated no bias by test modes, 
suggesting that the meaning of these results did not imply something important 
about the test format. 


Taherbhai et al. 
(2012) 


The accommodations or modifications changed the construct/s (n=2) 


Lovett (2011) The extended-time accommodation changed the meaning of students’ test per- 
formance, according to this review of literature. 


The basic function calculator modification functioned differently for some items 
in state mathematics assessment item performance of students with disabilities 
and students without disabilities. On one item, students with disabilities’ per- 
formance with the calculator was higher than performance without the modi- 
fication; on another item, students without disabilities performed better than 
students with disabilities with the calculator modification as well as without the 
modification. 


Randall et al. 
(2011) 


Construct validity was affected by other factor/s (n=2) 


An accommodations package (read aloud, frequent breaks, and separate 
quiet setting) supported improved scores for students with disabilities on some 
specific items on a state math assessment; students’ ability levels affected the 
degree of benefit from the accommodations package. 


Cho et al. (2012) 


Fourteen out of 34 math items exhibited differential item functioning (DIF) when 
comparing scores of examinees with disabilities who used a calculator and stu- 
dents with disabilities who did not have any accommodations. Of these items, 
eight were easier for the accommodated group, and six were easier for the 
nonaccommodated group. Results also revealed that item difficulty and student 
ability level contribute to differences in performance above and beyond accom- 
modation status. 


The manner of scoring changed the construct/s being tested (n=1) 


When comparing group mean scores of students with language learning dis- 
abilities (LLD) and students without disabilities analytically, the former scored 
significantly lower for many elements on narrative writing, but did so for fewer 
elements on expository writing. Specifically, both groups scored similarly on 
productivity and clausal density, which researchers attributed to the complexity 
of the writing prompts. In other words, the wording of the instructions or ques- 
tions supported students with LLD in performing a skill better. When comparing 
participant groups holistically, the students with LLD scored significantly lower 
than the students without disabilities on all six traits. This was expected, as the 
combination of skill measures effectively blended the individual skill strengths 
and weaknesses, resulting in a lower overall score. 


Scarpati et al. 
(2011) 


Koutsoftas & 
Gray (2012) 
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Table F-10. Findings for Studies Examining Accommodations in Postsecondary Settings 


(n=15) 


Postsecondary student performance (n=4) 


Gregg (2012) 


Gregg & Nelson 
(2012) 


Holmes & Silvestri 
(2012) 


Schmitt et al. 
(2012) 


NCEO 


The primary result of this literature review was that relatively few studies 
empirically examined effects of testing accommodations in postsecond- 

ary education and work settings. Of the 32 studies identified as relevant to 
accommodations for testing, 29 specifically addressed extended time. The 
researcher found that extended-time supported many adolescents and adults 
with learning disabilities effectively. When academic content areas were speci- 
fied, most of the studies pertained to reading testing, mathematics was the 
next-most common, and only one study examined writing performance. Other 
specific effects of the accommodations noted during testing were not reported 
by the researcher. 


This meta-analysis examined nine studies, ranging from 1986 to 2006, yet 
empirical conclusions pertaining to extended-time drew from fewer studies. 
Three studies indicated that youth with learning disabilities scored significantly 
higher with extended-time than without, with medium to large effect sizes. Two 
studies found that youth without disabilities also scored moderately higher 
with accommodations, with small to large effect sizes. Two studies supported 
the differential boost hypothesis, indicating the benefits from extended time 


were greater for youth with learning disabilities than youth without disabilities. 


The results of this literature review indicated that text-to-speech supported 
reading, benefiting comprehension, reading rate, and task persistence. The 
degree of benefit in some areas depended on the degree of reading disabili- 
ties, in that those with more difficulties exhibited improvements more than 
those with fewer difficulties. For instance, people with phonological processing 
challenges were aided more than others. Also, two studies in the literature re- 
view indicated that word processing assisted writing outputs for postsecondary 
students, improving spelling error detection, increasing GPAs, and changed 
course completion to a rate similar to students without disabilities. 


The degree of score improvement across the accommodation conditions was 
not consistent for all participants. The student with the lowest comprehension 
skills, specifically oral fluency, demonstrated the most benefit of the three par- 
ticipants when using the reading pen, in both conditions. However, when using 
the reading pen for vocabulary definition, she mostly scored lower than when 
using the read-aloud only tool setting. The other two participants’ comprehen- 
sion skills actually worsened when using the reading pen than when not doing 
so, which the researchers attributed to those participants having difficulties 
manipulating the reading pen and disrupting their reading fluency. 
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Postsecondary faculty perceptions (n=4) 


Brockelmann 
(2011) 


lhori (2012) 


Phillips et al. 
(2012) 


Posey & Hender- 
son (2012) 
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The most broadly used assessment accommodations included extended-time 
for exams and using a private testing space, such as in the testing center, 
and the least commonly used assessment accommodation was alternate test 
format. Of the strategies rated as most effective, the assessment accommoda- 
tion identified was extended time for exams. When comparing the subset of 
participants who were STEM or non-STEM faculty, each group used a similar 
average number of strategies, but the types of strategies differed. STEM fac- 
ulty members used the following significantly more frequently than non-STEM 
faculty members: extended time for exams, using a private testing room, and 
changing the form or format of the exam—permitting read-aloud, dictation, 
word-processing, and scribing. When comparing the STEM and non-STEM 
faculty about their effectiveness ratings of assessment accommodations, 
STEM faculty members rated extended-time for exams as more effective than 
non-STEM faculty members rated that accommodation. 


There were no significant differences in survey response patterns of faculty 
participants based on being at two-year or four-year institutions, nor any differ- 
ences based on being at public or private four-year institutions. That is, faculty 
members had similar attitudes and beliefs about students with ADHD, similar 
knowledge bases about legal protections for students with ADHD, and similar 
willingness to accommodate students with ADHD. A small proportion—10-20% 
or so—of the survey responses across the participant population indicated 
limited Knowledge about aspects of accommodations. For example, about 
20% indicated disagreement with accommodating students with ADHD on the 
response method for exams, and 25% expressed disagreement with permit- 
ting laptop, calculator, or spell checker during exams. 


Almost one-quarter (24%) of the faculty participants reported having provided 
online course testing accommodations (extended-time, alternate test formats, 
and/or assistive technology) to students with disabilities that were verified by 
Disability Services, and 15% had provided online accommodations for stu- 
dents who self-reported their disabilities to the faculty members. Most faculty 
participants (53%) had substantial experience with online courses (requiring 
no assistance with managing technology), yet a majority of participants (54%) 
were uncertain about their capability to manage providing online accommo- 
dations, with only about one-third (34%) of faculty indicating that they were 
capable of doing so. Of those faculty members who had provided online ac- 
commodations, most indicated their perception that there had been no change 
in the nature or degree of student requests for accommodations. In fact, they 
indicated that students already used accommodations from their own resourc- 
es, chose not to use accommodations, or chose not to request accommoda- 
tions from the university. Further, some participants indicated their views that 
implementing universal design principles addressed students’ needs without 
accommodations. Recommendations from participants centered on the need 
of both faculty and students for ongoing institutional support regarding accom- 
modations for online courses. 


Educators provided feedback in the form of suggestions for improving test 
administration instructions, such as consistent page numbering, as well as for 
improving the construction of the test, such as prompts related to changes in 
item types and formats. 
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Postsecondary student perceptions (n=3) 


Bolt et al. (2011) 


Makeham & Lee 
(2012) 


Schmitt et al. 
(2012) 


In terms of degree of helpfulness, participants using certain accommodations 
indicated that these were most helpful: in high school, extended-time, diction- 
ary use, and dictated response to a scribe; in college, dictated response to a 
scribe, and word processor with spell-check. In terms of barriers to accommo- 
dations use, the largest proportion (36%) of participants indicated that under- 
lying reasons were system-level issues, such as accessing support, specifying 
appropriate accommodations, and documentation of diagnosis, among others. 
Other barrier categories (besides systems issues) were oneself (19%)—em- 
barrassment and failing to advocate, and others (17%)—lack of knowledge or 
negative attitudes. Facilitators of accommodations use, in order of proportion 
of participants endorsing them, included other individuals (34%), system-level 
issues (32%), and self (7%). 


The results were primarily reported as categorized qualitative data about 
students’ perceptions. All participants indicated social discomfort, including 
embarrassment, when offered a human exam reader. In comparison with a 
human reader, many participants stated a preference for iPod aural presenta- 
tion. Three examinees used the accommodation during math exams and three 
examinees used the accommodation during course exams requiring written 
essays. Two of the three math examinees were also the two students report- 
ing the greatest benefit with the iPod. Compared with having only printed 
exams, they noted that this recorded read-aloud exam supported their needs 
for understanding what was being asked of them by the additional cues of 
intonation and pacing. Three of the students reported little or no benefit from 
using the iPod-presented read-aloud, compared with printed exam alone; their 
comments indicated that this accommodation (oral delivery) via any medium 
would not be helpful to them. 


There seemed to be an inverse relationship between actual benefits and 
enjoyment of using the reading pen: the lowest-skilled participant indicated a 
lesser degree of satisfaction than the other two participants. 


Postsecondary accommodations practices/uses (n=3) 


Bolt et al. (2011) 


NCEO 


About half of the participants (N=30) received accommodations through 
special education and/or Section 504 services in high school, as well as in col- 
lege, with the remainder accessing accommodations only at the postsecond- 
ary level. In both the high school and postsecondary levels, the rank order of 
commonality of accommodation category was: scheduling accommodations, 
setting accommodations, presentation accommodations, and response ac- 
commodations. The most common single accommodation used at both levels 
was extended-time, followed by individual setting. It was more common to 

be provided via oral delivery using a human reader in high school, and more 
common via computer using text-to-speech software in college. 
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Holmes & Silvestri 
(2012) 


Shinn & Ofiesh 
(2012) 


In this literature review identifying needs of postsecondary students and the 
ways assistive technology (AT) is used to address them, the researchers 
indicated that AT for reading could include software programs with functions 
such as text-to-speech, optical character recognition (OCR), and synthe- 
sized speech; for writing, software functions could include: speech- or voice- 
recognition, word prediction, and mind mapping and outlining. More research 
attention was paid to AT studies examining impacts on reading, and little or 
none on writing. 


Fitting with the cognitive issues being reviewed, the researchers described 
both universal design and accommodations solutions: for access demands, 
font size, text-to-speech software, and other presentation and appearance- 
based aspects; and for output demands, extended-time, word processing 

and keyboard composition via computer access, and dictation software. The 
researchers presented a model for training university instructors to implement 
universal design and accommodations. 


Postsecondary accommodations validity (n=1) 


Posey & Hender- 
son (2012) 


There were no significant differences in reading skills assessment scores be- 
tween the group of students with visual impairments and the group of students 
without disabilities. Put another way, the use of contracted braille for the test 
items permitted students with visual impairments to access the test and per- 
form at a level commensurate with students without disabilities. 


Table F-11. Findings for Studies Examining Accommodations for Mathematics Assessments 


(n=28) 


MATHEMATICS PERFORMANCE EFFECTS (n=12) 
Students with Disabilities (n=7) 
Accommodations did not support improved math performance for students with disabilities 


(n=3) 


Bouck et al. 
(2011) 


Cawthon et al. 
(2012) 


Cawthon et al. 
(2011) 
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The voice-input, speech-output (VISO) calculator, using aspects of speech-rec- 
ognition and dictated-response accommodations, required more time and more 
item attempts to complete calculations on math assessment items than did the 
typical strategies of students with visual impairments. 


Linguistic complexity had impacts on both math and reading items; its relative 
effect for math items was rated as lower than that of reading items, indicat- 

ing that students with learning disabilities had comparatively less difficulty 

with math on average. Accommodations in all four categories of presentation, 
response, setting, and timing were not associated with any differences in math 
item performance for students with learning disabilities. There were no interac- 
tion effects of linguistic complexity and accommodation types on math items, 
suggesting that the effect of linguistic complexity did not depend on the accom- 
modations received by students with learning disabilities. 


No significant differences were found in overall performance between the writ- 
ten English for items and items presented via American sign language (ASL). 
ASL exposure was largely not a significant predictor of performance. 
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Accommodations had mixed results on math assessments for students with disabilities 
(n=2) 
On average, performance on 5 math items was not significantly different with 
the use of the oral delivery accommodation, presented by a human reader, 
Lazarus et al. than performance on the other, similar, 5 items without the oral delivery ac- 
(2012) commodation. When reviewed individually, 7 students scored higher with the 
accommodation, 8 students scored higher without the accommodation, and 9 
students scored the same. 


On state math assessments, the calculator accommodation provided a dif- 
Scarpati et al. ferential boost on some items for students with disabilities, whereas not using 
(2011) accommodations for some items provided a differential boost for students with 
disabilities. 
Accommodation set supported improved math performance for students with disabilities 
more than another accommodation set (n=1) 


Results showed no differences in effect sizes between grade levels, suggest- 
ing that there were no differences across grade/school levels. There were 
differences in effect sizes between academic content, with larger effect sizes 
found for reading than for math or science. There were small to moderate dif- 
ferences between paper-and-pencil test and computer-based test conditions 
that tended to favor the paper-and-pencil test condition. The researchers noted 
that scores were generally lower in the computer-based testing condition, but 
that this trend may have been due to extraneous factors. DIF analyses showed 
that items did not favor either group more frequently. [Packages: computerized 


Flowers et al. 
(2011) 


format with oral-delivery accommodation via text-to-speech software vs. print 
text format with human reader] 


Accommodations supported improved math performance for students with disabilities (n=1) 


Grade 3 students with math disabilities scored significantly better on geometry 
assessment items with the visual chunking accommodation—which supported 
visual memory—than without it. 


Zhang et al. 
(2012) 


All Students (n=5) 


Accommodation did not support improved math performance for either students with dis- 

abilities or students without disabilities (n=2) 

Results showed that math resource guides, providing definitions of academic 
terms as well as graphics, were not an effective accommodation for students 
with or without disabilities. 


The researchers demonstrated the feasibility, at least on a small scale, of shift- 
ing the mode from paper to electronic computer-based format. For the youth 
and adult test-takers using paper-based then computerized tests, there were 
no significant differences in final test scores. In other words, the 25 test-takers 
using NimbleTools on computerized tests scored higher than test-takers had 
on the accommodated paper tests, although the difference was not statistically 
significant. 


Enhancements supported improved math performance for all students (n=1) 

Engelhard et al. Calculator use seemed to result in a small increase in the mean scores of stu- 
(2011) dents with and without disabilities in both age groups in most cases. 
Accommodation provided differential benefits in math performance scores of students with 
disabilities compared to those of students without disabilities (n=1) 


Engelhard et al. 
(2011) 


Patterson et al. 
(2011) 
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This meta-analysis examined nine studies, ranging from 1986 to 2006, yet em- 
pirical conclusions pertaining to extended-time drew from fewer studies. Three 
studies indicated that youth with learning disabilities scored significantly higher 
on assessments of math, reading, and writing when using extended-time than 
without, with medium to large effect sizes. Two studies found that youth without 
disabilities also scored moderately higher with accommodations, with small 

to large effect sizes. Two studies supported the differential boost hypothesis, 
indicating the benefits from extended time were greater for youth with learning 
disabilities than youth without disabilities. 


Gregg & Nelson 
(2012) 


A unique modification supported improvements differentially for a subset of students with 
disabilities who were eligible for modified math assessments (n=1) 


Various modifications—including simplified language, removal of response op- 
tion, graphic support, and reorganization of layout—were analyzed for reliabil- 
ity. When the modifications were examined separately, for the sets of math and 
reading assessment items, the modification of shortening the item stem dif- 
ferentially supported students with disabilities who were identified as eligible for 
modified assessments (in comparison to students with disabilities not eligible 
for modified assessments and in comparison to students without disabilities). 


PERCEPTIONS OF ACCOMMODATIONS IN MATHEMATICS (n=6) 
Students/test-takers only (n=4) 


Kettler et al. 
(2011) 


Students indicated that using accommodations and/or modifications benefited them in 
terms of math performance score (n=2) 


The survey findings included that all students comprehended the modified 
items better than the standard items. Students without IEPs comprehended 
items (both standard and modified forms) better than the students with IEPs. 
All students reported that they had to work less to answer modified items than 
standard items. Similarly, students without IEPs indicated a lower degree of 
cognitive load than students with IEPs indicated, for both modified and stan- 
dard items. Students also offered their perceptions of their having learned the 
content, and confidence in being correct on the items. 


Most of the students (61%) reported that using oral delivery reduced stress as- 
Lazarus et al sociated with test-taking, and/or helped them arrive at correct answers on the 
(2012) mathematics test, yet only 7 of the 24 students scored higher when using this 
accommodation. 


Beddow (2011) 


Students indicated that using accommodations benefited them beyond math performance 
score improvements (n=1) 


Survey results indicated that 61% of youth and adult participants preferred to 
Patterson et al. take the GED Tests via computer, and that 61% preferred to use NimbleTools 
(2011) rather than be tested on paper. Also, about 75% of participants indicated that it 
was easy to use NimbleTools. 


Students with disabilities expressed preference for using one version of an accommodation 
over another on the math test (n=1) 


Grade 3 students with math disabilities reported a preference for using visual 
chunking representation on geometry assessment items, and reported that the 
items were easier when using visual chunking. 


Educators only (n=1) 


Zhang et al. 
(2012) 


Educators indicated that using accommodations benefited students beyond math perfor- 
mance score improvements (n=1) 
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Test administrators had views that the oral delivery accommodation, presented 
by test administrators, provided a range of benefits. In addition to supporting 
reading and providing access to tests, oral delivery can assist with focus when 
students have difficulty with testing endurance and motivation, and can de- 
Hodgson et al. crease concentration if administrator's reading pace differs with students’ pace. 
(2012) In comparison with other academic content tests, read-aloud provided dur- 
ing math tests differed in how it was implemented. For example, participants 
indicated that administration of read aloud on math tests required more training 
and math content familiarity, in order to limit inadvertent pronunciation mistakes 
and variations in following guidelines across administrators. 


Students/Test-takers and Educators (n=1) 


Students with disabilities and their teachers indicated students’ preference for using one 
accommodation package over another on the mathematics tests (n=1) 

Teachers and students both reported that students preferred the computer- 
based test condition (although the results did not support better performance in 
this condition) over the print format condition. 

ACCOMMODATIONS USES AND PRACTICES ON MATHEMATICS ASSESSMENTS (n=5) 


A common math assessment accommodation provided to students with disabilities was oral 
delivery (n=1) 


Flowers et al. 
(2011) 


The researchers found that this state is similar to many others in which oral de- 
livery has been provided using human readers on state mathematics assess- 
ments as one of the most frequent accommodations offered. In comparison 
with other accommodations, oral delivery was used more often than accommo- 
dations such as breaks, calculator, enlarged print, and scribe, among others. 


Flowers et al. 
(2011) 


The oral delivery accommodation on math assessments has had variations in its manner of 
administration (n=1) 
The researchers found that there were variations in administration practices— 
some arranged small-group or individual space for providing oral delivery via 
human readers, and some provided oral delivery to students with similar read- 
Flowers et al. ing pacing needs. Additionally, oral delivery was provided in combination with 
(2011) other accommodations such as alternative setting or frequent breaks, due to 
the circumstances of having a person read the test aloud, rather than because 
those other accommodations were identified in the individualized education 
program (IEP) plan. 


The oral delivery accommodation was implemented differently in math than in other content 
areas (n=1) 


In comparison with other academic content tests, oral delivery provided during 
math tests differed in how it was implemented. For example, participants indi- 
cated that administration of oral delivery on math tests required more training 
and math content familiarity, in order to limit inadvertent pronunciation mistakes 
and variations in following guidelines across administrators. 


Flowers et al. 
(2011) 


Common accommodations for students with visual impairments on math assessments in- 
cluded large print, setting-based, and extended-time (n=1) 
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Fox (2012) 


For students with visual impairments (VI), the most commonly used accom- 
modation in both math and reading for the three test years was large print, 
followed in popularity by small group, separate room (individual), and extended 
time. For only some students with VI, there were a few patterns of accommo- 
dations bundles in either reading or math, such as large-print and extended- 
time and magnification and administrator-transcription and sometimes dictated- 
response. Another bundle used consistently across years for some students 
was braille and extended-time and separate room (individual) and dictated- 
response and sometimes braille writer. However, from a longitudinal view of ac- 
commodations use, there were very few trends across years in the number or 
type of accommodations; that is, students typically might be provided specific 
accommodations in one year but different accommodations in another. 


This subset of students with visual impairments had unusual accommodations use patterns 


(n=1) 


Zebehazy et al. 
(2012) 


From among students with visual impairments who participated in the state 
alternate assessments in math (and reading), students with more functional 
vision performed better overall than students using vision for some or no tasks. 
Students using more vision to complete tasks also received fewer accommoda- 
tions, though students with less vision sometimes did not receive accommoda- 
tions as well, which may present a problem of accessibility and availability of 
accommodations. 


MATHEMATICS ASSESSMENT VALIDITY (n=5) 
Construct validity was affected by other factor/s (n=2) 


Cho et al. (2012) 


Scarpati et al. 
(2011) 


An accommodations package (read-aloud, frequent breaks, and separate 
quiet setting) supported improved scores for students with disabilities on some 
specific items on a state math assessment; students’ ability levels affected the 
degree of benefit from the accommodations package. 


Fourteen out of 34 items exhibited differential item functioning (DIF) when 
comparing scores of examinees with disabilities who used a calculator and stu- 
dents with disabilities who did not have any accommodations. Of these items, 
eight were easier for the accommodated group, and six were easier for the 
nonaccommodated group. Results also revealed that item difficulty and student 
ability level contribute to differences in performance above and beyond accom- 
modation status. 


The accommodations did not change the math construct/s being tested (n=2) 


Flowers et al. 
(2011) 
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The computer administration accommodation with text-to-speech software 
package (when compared with the print text format presented by human 
reader) did not change the academic constructs of reading, science, and math- 
ematics on the state assessment. 
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At the test-level, there were no significant differences between scores on the 
paper and pencil and online test modes, for both math and reading; that is, the 
online test mode did not benefit students with learning disabilities (L_D) more 
than the paper-based testing condition. At the item level, some individual items 
in both grade levels and both content areas behaved differently between the 
test modes. The paper-based format benefited students with LD on only a cou- 
ple of the paper-based math items, and the online format benefited students 
with LD on a few more of the math items, all at a moderate level of differential 
item functioning (DIF). However, the researchers note that the number of items 
showing these differences were fewer than might occur by chance, and item 
content analysis by experts indicated no bias by test modes, suggesting that 
the meaning of these results did not imply something important about the test 
format. 


The accommodations or modifications changed the math construct/s (n=1) 


Students with disabilities scored lower as a group than students without dis- 
abilities across all conditions. All students separately using the basic function 
Randall et al. calculator modification, and all students using the math resource guide modifi- 
(2011) cation (providing key definitions and examples as well as graphics) scored bet- 
ter than those taking the standard test, with no significant differences between 
groups across items. 


Taherbhai et al. 
(2012) 


Table F-12. Findings for Studies Examining Accommodations for Reading Assessments (n=26) 


READING PERFORMANCE EFFECTS (n=11) 
Students with Disabilities (n=6) 


Accommodations had mixed results on reading assessments for students with disabilities 
(n=2) 

Linguistic complexity had impacts on both reading and math items; its relative 
effect for reading items was rated as higher than that of math items, indicating 
that students with learning disabilities had comparatively more difficulty with 
reading on average. Accommodations in two categories—namely presentation 
and setting—were associated with differences in reading item performance for 
students with learning disabilities; specifically, students with disabilities using 
these accommodation types had lower scores than students with learning 
disabilities not using accommodations. However, response accommodations 
and timing accommodations were not associated with differences in reading 
performance for students with learning disabilities. There were no interaction 
effects of linguistic complexity and accommodation types on reading items, 
suggesting that the effect of linguistic complexity did not depend on the ac- 
commodations received by students with learning disabilities. 


Cawthon et al. 
(2012) 
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The degree of score improvement across the accommodation conditions was 
not consistent for all participants. The student with the lowest comprehension 
skills, specifically oral fluency, demonstrated the most benefit of the three par- 
ticipants when using the reading pen, in both conditions. However, when using 
the reading pen for vocabulary definition, she mostly scored lower than when 
using the oral delivery-only tool setting. The other two participants’ compre- 
hension skills actually worsened when using the reading pen than when not 
doing so, which the researchers attributed to those participants having difficul- 
ties manipulating the reading pen and disrupting their reading fluency. 


Schmitt et al. 
(2012) 


Accommodations supported improved reading performance for students with disabilities 
(n=2) 
The researcher reported in this literature review that extended-time was 


lege (2012) shown to support youth and adults with learning disabilities. 


The results of this literature review indicated that text-to-speech supported 
reading, benefiting comprehension, reading rate, and task persistence. The 
Holmes & Silvestri | degree of benefit in some areas depended on the degree of reading disabili- 
(2012) ties, in that those with more difficulties exhibited improvements more than 
those with fewer difficulties. For instance, people with phonological processing 
challenges were aided more than others. 


Accommodation set supported improved reading performance for students with disabilities 
more than another accommodation set (n=1) 


Results showed no differences in effect sizes between grade levels, suggest- 
ing that there were no differences across grade/school levels. There were 
differences in effect sizes between academic content, with larger effect sizes 
found for reading than for math or science. There were small to moderate 
differences between paper-and-pencil test and computer-based test condi- 
tions that tended to favor the paper-and-pencil test condition. The researchers 
noted that scores were generally lower in the computer-based testing condi- 
tion, but that this trend may have been due to extraneous factors. DIF analy- 
ses showed that items did not favor either group more frequently. (Packages: 
computerized format with oral delivery accommodation via text-to-speech 
software vs. print text format with human reader) 


Flowers et al. 
(2011) 


Accommodations did not support improved reading performance for students with disabili- 
ties (n=1) 
No significant differences were found in overall reading performance between 


the written English for items and items presented via American sign language 
(ASL). ASL exposure was largely not a significant predictor of performance. 


All Students (n=5) 
Accommodations package supported improved scores for all students in an equal manner 


(n=1) 


Cawthon et al. 
(2011) 


Results also showed that students with disabilities performed significantly 
worse than students without disabilities on the test. All students performed bet- 
Feldman et al. ter on reading items when given testing accommodations, and no interactions 
(2011) were found between groups and conditions (Suggesting that students with 
disabilities and students without disabilities benefitted equally from accommo- 
dations). 


Accommodation supported improvements differentially in reading performance scores of 
students with disabilities compared to those of students without disabilities (n=1) 
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This meta-analysis examined nine studies, ranging from 1986 to 2006, yet 
empirical conclusions pertaining to extended-time drew from fewer studies. 
Three studies indicated that youth with learning disabilities scored significantly 
higher on assessments and other testing for math, reading, and writing when 
using extended-time than without, with medium to large effect sizes. Two stud- 
ies found that youth without disabilities also scored moderately higher with 
accommodations, with small to large effect sizes. Two studies supported the 
differential boost hypothesis, indicating the benefits from extended-time were 
greater for youth with learning disabilities than youth without disabilities. 


Gregg & Nelson 
(2012) 


A unique modification supported differential benefits for a subset of students with disabili- 
ties who were eligible for modified reading assessments (n=1) 


Various modifications—including simplified language, removal of response 
option, graphic support, and reorganization of layout—were analyzed for reli- 
ability. When the modifications were examined separately, for the sets of math 
and reading assessment items, the modification of shortening the item stem 
differentially benefited students with disabilities who were identified as eligible 

Kettler et al. (2011) | for modified assessments. When the modifications were examined separately, 
for the sets of reading assessment items, the modification of adding graphics 
did not differentially benefit students with disabilities who were identified as 
eligible for modified reading assessments (in comparison to students with dis- 
abilities not eligible for modified assessments and in comparison to students 
without disabilities). 


Accommodations package supported improved scores for students with disabilities (n=1) 


Students with visual impairments scored significantly better when using the 
read-aloud accommodation, presented by an human reader, along with other 
accommodations than when using other accommodations alone, on Korean 

Kim (2012) reading assessment items, along with other accommodations than when using 
other accommodations alone. Students without disabilities scored lower when 
using read-aloud accommodations than when not doing so, although this dif- 
ference did not reach statistical significance. 


Accommodation did not support improved scores for students with disabilities more than 
the paper assessment format (n=1) 


Students without disabilities scored significantly higher than students with 
language-learning disabilities (LLD). The scores of students without disabili- 
ties were not significantly different between testing conditions. The students 
with LLD experienced the same pattern—no score differences between test 
formats. This was an unexpected result, as it was hypothesized that the 

Srivastava & Gray | computerized format with hyperlinked vocabulary definitions would increase 

(2012) students’ cognitive load. The researchers reviewed possible factors related 
to the finding, as well as the observation that students with LD did not often 
stop reading and review hyperlinked text. The mean passage-reading times 
and item response times across testing conditions did not differ significantly 
between students with and without LD, although students with LD tended to 
be somewhat slower. 


ACCOMMODATIONS USES AND PRACTICES ON READING ASSESSMENTS (n=7) 


Common accommodations for students with visual impairments on reading assessments 
included large print and extended-time (n=2) 
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Fox (2012) 


Kim (2012) 


For students with visual impairments (VI), the most commonly used accom- 
modation in both math and reading for the three test years was large print, 
followed in popularity by small group, separate room (individual), and ex- 
tended time. For only some students with VI, there were a few patterns of 
accommodations bundles in either reading or math, such as large print and 
extended time and magnification and administrator-transcription and some- 
times dictated-response. Another bundle used consistently across years for 
some students was braille and extended-time and separate room (individual) 
and dictated-response and sometimes braille writer. However, from a longitu- 
dinal view of accommodations use, there were very few trends across years 
in the number or type of accommodations; that is, students typically might be 
provided specific accommodations in one year but different accommodations 
in another. 


Students with visual impairments typically used the oral-delivery accommoda- 
tion presented by a human reader in combination with large print, braille, and 
extended time on reading assessments in South Korea. 


The oral delivery accommodation has had variations in its manner of administration during 
reading assessments (n=2) 


Flowers et al. 
(2011) 


Holmes & Silvestri 
(2012) 


A common reading 
oral delivery (n=1) 


Flowers et al. 
(2011) 
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The researchers found that there were variations in administration practices— 


some arranged small-group or individual space for providing oral delivery via 
human readers, and some provided oral delivery to students with similar read- 
ing pacing needs. Additionally, oral delivery was provided in combination with 
other accommodations such as alternative setting or frequent breaks, due to 
the circumstances of having a person read the test aloud, rather than because 
those other accommodations were identified in the individualized education 
program (IEP) plan. 


In this literature review identifying needs of postsecondary students and the 
ways assistive technology (AT) is used to address them, the researchers 
indicated that AT for reading assessments could include software programs 
with functions such as text-to-speech, optical character recognition (OCR), and 
synthesized speech. More research attention was paid to AT studies examining 
impacts on reading, and little or none on writing. 


assessment accommodation provided to students with disabilities was 


The researchers found that this state is similar to many others in which oral de- 
livery has been provided using human readers on state reading assessments 
as one of the most frequent accommodations offered. In comparison with other 
accommodations, oral delivery was used more often than accommodations 
such as breaks, calculator, enlarged print, and scribe, among others. 
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Common categories of reading assessment accommodations provided to youth with learn- 
ing disabilities include presentation and timing (n=1) 


In this literature review, the researcher identified the following accommodations 
for use during reading tests: presentation—oral delivery via text-to-speech 
(TTS) or human reader (but qualifying that attention needs to be paid to ensur- 
ing that reading construct has not changed); timing/scheduling—extended 
time, frequent breaks, unlimited time, and testing over multiple days. Only one 
study about read aloud during reading testing was identified. 


Gregg (2012) 


This subset of students with visual impairments had unusual accommodations use patterns 
(n=1) 

From among students with visual impairments who participated in the state 
alternate assessments in reading (and math), students with more functional 
vision performed better overall than students using vision for some or no tasks. 
Students using more vision to complete tasks also received fewer accommoda- 
tions, though students with less vision sometimes did not receive accommoda- 
tions as well, which may present a problem of accessibility and availability of 
accommodations. 


PERCEPTIONS OF ACCOMMODATIONS IN READING (n=5) 
Students/test-takers only (n=4) 


Students expressed a preference for one or more accommodations over one or more others 
(n=1) 


Zebehazy et al. 
(2012) 


Students with visual impairments expressed a preference for using oral de- 
livery accommodation when presented by a human reader, noting that they 
moved more slowly through the test items when using either braille or magni- 

Kim (2012) fication alone, and that they had difficulties with reading long text passages. 
Almost all students without disabilities reported that they were more comfort- 
able not using read-aloud accommodations, noting that their reading speed 
was faster than the rate of read-aloud accommodation. 


Students indicated that using accommodations benefited them beyond performance score 
improvements (n=1) 

Results revealed that no significant differences existed between students with 
disabilities and students without disabilities in motivation, positive regard, and 
anxiety. Students with disabilities displayed significantly lower mean scores 
for self-efficacy on the pretest questionnaire than students without disabilities. 
Finally, results indicated that accommodations had an effect on test-related 
thoughts and attitudes, regardless of disability status. For example, students 
who received accommodations showed larger increases between the pre- 
and post-test on measures of self-efficacy than students who did not receive 
accommodations. For students with disabilities, receiving accommodations 
appeared to increase motivation to work hard, whereas for students without 
disabilities this was not the case. 


Feldman et al. 
(2011) 


Student perceptions were mixed about the accommodations studied (n=1) 


There seemed to be an inverse relationship between actual benefits and 

Schmitt et al. ; ; os ace 

(2012) enjoyment of using the reading pen: the lowest-skilled participant indicated a 
lesser degree of satisfaction than the other two participants. 


Educators only (n=1) 
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Educators recommended improvements in test administration instructions in order to en- 
sure appropriate supports including accommodations were provided (n=1) 


Educators provided feedback in the form of suggestions for improving test 
Posey & Hender- | administration instructions, such as consistent page numbering, as well as for 
son (2012) improving the construction of the test, such as prompts related to changes in 
item types and formats. 


Students/Test-takers and Educators (n=1) 


Students with disabilities and their teachers indicated students’ preference for using one 
accommodation package over another on the reading tests (n=1) 


Teachers and students both reported that students preferred the computer- 
Flowers et al. ie : 

based test condition (although the results did not support better performance 
(2011) eae ve ae 

in this condition) over the print format condition. 


READING ASSESSMENT VALIDITY (n=3) 
The accommodations did not change the reading construct/s being tested (n=3) 


The computer administration accommodation with text-to-speech software 
Flowers et al. package (when compared with the print text format presented by human 


(2011) reader) did not change the academic constructs of reading, science, and 
mathematics on the state assessment. 


There were no significant differences in reading skills assessment scores be- 
tween the group of students with visual impairments and the group of students 
without disabilities. Put another way, the use of contracted braille for the test 
items permitted students with visual impairments to access the test and per- 
form at a level commensurate with students without disabilities. 


Posey & Hender- 
son (2012) 


At the test-level, there were no significant differences between scores on the 
paper and pencil and online test modes, for both math and reading; that is, the 
online test mode did not benefit students with learning disabilities (LD) more 
than the paper-based testing condition. At the item level, some individual items 
in both grade levels and both content areas behaved differently between the 
test modes. The online format benefited students with LD on a few more of 
the reading items, all at a moderate level of differential item functioning (DIF). 
However, the researchers note that the number of items showing these differ- 
ences were fewer than might occur by chance, and item content analysis by 
experts indicated no bias by test modes, suggesting that the meaning of these 
results did not imply something important about the test format. 


Taherbhai et al. 
(2012) 
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Table F-13. Findings for Studies Examining Accommodations for Science Assessmenis (n=9) 


SCIENCE PERFORMANCE EFFECTS (n=3) 
All Students (n=2) 


Enhancement supported improved science performance for all—students with disabilities as 
well as students without disabilities (n=1) 


All students’ scores on enhanced tests averaged about 2 points higher than on 
the unenhanced form, and differences by participant groups were similar, indi- 
Kettler et al. cating no differential benefits in total score for students with or without disabili- 
(2012) ties. Enhancements which seemed beneficial included shorter item stems, and 
enhancements that did not seem beneficial included bulleted text and simplified 
graphics, according to the specific items which had those enhancements. 


Accommodation supported improved science assessment performance of all students (n=1) 


Students using oral delivery accommodations, via audio recording, scored a 
higher total score than students not using read aloud for one of the science 

Shelton (2012) content modules, but no difference in scores for the other science content mod- 
ule tests. When controlling for learning disability status, there were no score 
differences in any of the modules. 


Students with Disabilities (n=1) 


Accommodation set supported improved science performance for students with disabilities 
more than another accommodation set (n=1) 


Assessment results comparisons for accommodations packages showed no 
differences in effect sizes between grade levels, suggesting that there were 
no differences across grade/school levels. There were differences in effect 
sizes between academic content, with larger effect sizes found for reading 
than for math or science. There were small to moderate differences between 

Flowers et al. paper-and-pencil test and computer-based test conditions that tended to favor 

(2011) the paper-and-pencil test condition. The researchers noted that scores were 
generally lower in the computer-based testing condition, but that this trend may 
have been due to extraneous factors. DIF analyses showed that items did not 
favor either group more frequently. [Packages: computerized format with oral 
delivery accommodation via text-to-speech software vs. print text format with 
human reader] 


PERCEPTIONS OF ACCOMMODATIONS IN SCIENCE (n=3) 
Students/test-takers (n=2) 


Students indicated that using enhancements benefited them in terms of performance score 
(n=1) 
The test-takers mostly indicated that the enhancements (accommodations or 
Kettler et al. modifications) seemed to decrease the difficulty of testing, but when viewing 
(2012) specific original items and enhanced items, they indicated that each item had a 
similar level of difficulty. 


Students indicated that using accommodations benefited them beyond performance score 
improvements (n=1) 
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Students indicated on surveys about their generally positive perceptions 
about the oral delivery testing condition. An example survey question asked 
about participants’ use of oral delivery, specifically of listening to the charac- 
ters explain the problem. Most test-takers (87%) indicated that they had done 
so to varying degrees from very much to very little, and only 13% responded 
that they did not do so at all. Another survey item inquired about the degree 

Shelton (2012) to which the characters speaking was distracting; 34% responded that they 
disagreed and 22% responded that they strongly disagreed with that notion, 
and about 27% indicated a neutral response about distractedness. Only 17% 
indicated that they were distracted by the characters speaking. Students with 
learning disabilities tended to have a more positive perception of hearing the 
segments of characters speaking, and tended not to find them distracting but 
rather useful to form their test answers. 


Students/Test-takers and Educators (n=1) 


Students with disabilities and their teachers indicated students’ preference for using one ac- 
commodation package over another on the science tests (n=1) 


Teachers and students both reported that students preferred the computer- 
based test condition (although the results did not support better performance in 
this condition) over the print format condition. 


Flowers et al. 
(2011) 


ACCOMMODATIONS USES AND PRACTICES ON SCIENCE ASSESSMENTS (n=2) 


A common accommodation provided to students with disabilities was oral delivery (n=1) 


The researchers found that this state is similar to many others in which oral de- 
livery has been provided using human readers on state science assessments 
as one of the most frequent accommodations offered. In comparison with other 
accommodations, oral delivery was used more often than accommodations 
such as breaks, calculator, enlarged print, and scribe, among others. 


Flowers et al. 
(2011) 


The oral delivery accommodation has had variations in its manner of administration (n=1) 


The researchers found that there were variations in administration practices— 
some arranged small-group or individual space for providing oral delivery via 
human readers, and some provided oral delivery to students with similar read- 

Flowers et al. ing pacing needs. Additionally, oral delivery was provided in combination with 

(2011) other accommodations such as alternative setting or frequent breaks, due to 
the circumstances of having a person read the test aloud, rather than because 
those other accommodations were identified in the individualized education 
program (IEP) plan. 


SCIENCE ASSESSMENT VALIDITY (n=1) 
The accommodations DID NOT change the reading construct/s being tested (n=1) 


The computer administration accommodation with text-to-speech software 
Flowers et al. package (when compared with the print text format presented by human read- 
(2011) er) did not change the academic constructs of reading, science, and mathemat- 
ics on the state assessment. 
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Table F-14. Findings for Studies Examining Accommodations for Writing Assessments (n=5) 


WRITING PERFORMANCE EFFECTS (n=4) 
Students with Disabilities (n=3) 


Accommodation supported improved writing performance for students with disabilities 
(n=2) 


The researcher noted only one study about writing performance, which indi- 
Gregg (2012) cated that extended time was effective in supporting adult basic education 
students. 
The results of this literature review highlighted in two studies indicated that 
Holmes & Silvestri | word-processing assisted writing outputs for postsecondary students, improv- 
(2012) ing spelling error detection, increasing GPAs, and changed course completion 
to a rate similar to students without disabilities. 
Accommodation neither supported nor failed to support improved writing performance 
scores of students with disabilities (n=1) 


In this literature review, the researcher noted that word-processing has had 


Gregg (2012) inconclusive effects during writing testing for adult basic education students 
with learning disabilities. 


All Students (n=1) 


Accommodation provided differential benefits in writing performance scores of students 
with disabilities compared to those of students without disabilities (n=1) 


This meta-analysis examined nine studies, ranging from 1986 to 2006, yet em- 
pirical conclusions pertaining to extended-time drew from fewer studies. Three 
studies indicated that youth with learning disabilities scored significantly higher 
on assessments and other testing for math, reading, and writing when using 
extended time than without, with medium to large effect sizes. Two studies 
found that youth without disabilities also scored moderately higher with accom- 
modations, with small to large effect sizes. Two studies supported the differen- 
tial boost hypothesis, indicating the benefits from extended time were greater 
for youth with learning disabilities than youth without disabilities. 


ACCOMMODATIONS USES AND PRACTICES ON WRITING ASSESSMENTS (n=1) 
The oral delivery accommodation has had variations in its implementation (n=1) 


Gregg & Nelson 
(2012) 
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Holmes & Silvestri 
(2012) 


In this literature review identifying needs of postsecondary students and the 
ways assistive technology (AT) is used to address them, the researchers 
indicated that AT for writing could include software programs with functions 
such as speech- or voice-recognition, word prediction, and mind mapping and 
outlining. More research attention was paid to AT studies examining impacts 
on reading, and little or none on writing. 


WRITING ASSESSMENT VALIDITY (n=1) 


The manner of scoring writing tests and assessments changed the reading construct/s be- 


ing tested (n=1) 


Koutsoftas & Gray 
(2012) 


When comparing group mean scores of students with language learning dis- 
abilities (LLD) and students without disabilities analytically, the former scored 
significantly lower for many elements on narrative writing, but did so for fewer 
elements on expository writing. Specifically, both groups scored similarly on 
productivity and clausal density, which researchers attributed to the complexity 
of the writing prompts. In other words, the wording of the instructions or ques- 
tions supported students with LLD in performing a skill better. When comparing 
participant groups holistically, the students with LLD scored significantly lower 
than the students without disabilities on all six traits. This was expected, as the 
combination of skill measures effectively blended the individual skill strengths 
and weaknesses, resulting in a lower overall score. 


Table F-15. Findings for Studies Examining Accommodations for English language proficiency 
(ELP) Assessments (n=1) 


Common accommodations for English language learners (ELLs) with disabilities involved 
modifying test directions, test format, and timing (n=1) 


Kuti (2011) 
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Students with disabilities who were English language learners (ELLs) complet- 
ing the ACCESS for ELLs testing (English language proficiency assessments) 
used various combinations of 11 accommodations. The most commonly pro- 
vided accommodations included modified test directions, modified timing, other 
accommodation (practices for reducing test anxiety), and modified presentation 
format. 
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